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Message 

From: Haworth, Patty [patty.haworth@walgreens.com] 

Sent: 8/11/2014 7:58:31 PM 

To: Raju, Mahesh [mahesh.raju@walgreens.com]; Joe Ahdoot [jahdoot@theranos.com]; Christian Holmes 
[cholmes@theranos.com]; Sizemore, Brian [brian.sizemore @walgreens.com]; Kimberly Alfonso 
[kalfonso@theranos.com]; Sunny Balwani [sbalwani@theranos.com]; Sesto, Matthew [matt.sesto@walgreens.com]; 
Nicholas Menchel [nmenchel@theranos.com]; Kozlowski, Casey [casey.kozlowski@walgreens.com]; Tracy Masson 
[tmasson@theranos.com]; Max Fosque [mfosque@theranos.com]; Ryan Karpel [rkarpel@theranos.com]; ‘Mike 
Lewis [mike.lewis@slalom.com]; Jnaveri, Nimesh [nimesh.jhaveri@walgreens.com]; Samoila, Ashley 
[ashley.samoila@walgreens.com]; Carroll, Patrick [patrick.carroll@walgreens.com] 

ce: Makris, Evie [Evie Makris@walgreens.com]; Look, John [john.look@walgreens.com]; Montague, Beth 


[beth.montague@walgreens.com] 

Subject: REVISED 8/6 Walgreens-Theranos Partnership Meeting Minutes & Slide Deck 

Attachments: Partnership Meeting Minutes 08-06-2014.pdf; Partnership Meeting Minutes 08-06-2014.docx; Theranos Walgreens 
Partnership Meeting August 2014 final.pptx 


Please see attached for revised slide deck including SMART goals that were discussed during the meeting. 


From: Haworth, Patty 

Sent: Monday, August 11, 2014 11:05 AM 

To: Raju, Mahesh; Joe Ahdoot (JAhdoot@theranos.com); Christian Holmes (cholmes@theranos.com); Sizemore, Brian; 
Kimberly Alfonso (kalfonso@theranos.com); Sunny Balwani (Sbalwani@theranos.com); Sesto, Matt 
(matt.sesto@walgreens.com); Nick Menchel (nmenchel@theranos.com); Casey Kozlowski 
(casey.kozlowski@walgreens.com); Tracy Masson; Max Fosque (mfosque@theranos.com); 'Ryan Karpel 
(rkarpel@theranos.com)'; 'Mike Lewis (mike.lewis@slalom.com)'; Jhaveri, Nimesh; Ashley Samoila 
(ashley.shovlin@walgreens.com); Carroll, Patrick 

Subject: 8/6 Walgreens-Theranos Partnership Meeting Minutes & Slide Deck 


All, 


Please see attached for 8/6 Walgreens-Theranos Partnership Meeting Minutes and slide deck. Let me know if you have 
any additions or corrections. 


Please block your calendar for our next meeting in Deerfield on October 2. 


Be well, 
Patty 


Patty Haworth, MBA, PMP 

Program Manager 

Pharmacy, Health and Wellness PMO 
Walgreen Co. 
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get, stay and live well. 
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Theranos/WAG Leadership 


Mid-wave Partnership 
Debrief 


ss! Tracy Masson, Christian Holmes, Kimberly 
_ Alfonso, Sunny Balwani, Nimesh Jhaveri, Casey 
Kozlowski, Nick Menchel, Joe Ahdoot, Max Fosque, 
Ashley Samoila, Matt Sesto, Brian Sizemore, Ryan 
-Karpel, Mahesh Raju, Mike Lewis, Pat Carroll, Patty 
Haworth 


O Kick-off/Introductions Sunny/Nimesh 9-9:10 am 

Current Status Sunny/Nimesh 9:10-9:30 am 

t] Discuss Anchored Values Mike Lewis 9:30-10:00 am 

O Discuss Program Measures of Success (GMART Goals) Nimesh 10:00-11:00 am 

oO -Plan for FY15 Casey 11:00-11:30 am 

O California Plans Sunny/Nimesh 11:30-11:45 am 

() STD Testing - review the new structure of quality reporting Pat Carroll 11:45 am-12:00 pm 


from the HealthCare Clinic 
oO Lunch All 12:00-1:00 pm 


Kickoff: 

e Sunny kicked off the meeting 

e Momentum is building and patient uptick is occurring 

e Met 3 times in arow (5/28, 7/10, 8/7); next meeting is 10/2 in Deerfield; 

e Nim commented ona big day for Walgreens to focus us even harder for what is next to focus on initiatives 
to drive value to Walgreens, our partners, and US health system 

e The project team is in the process of putting together a clearly articulated playbook, including people 
preparedness, marketing, operations, launch plans, etc. 

e Success has been through sheer muscle; we need to make it a seamless operation; if everyone went on 
vacation at the same time, we need to make sure operations are running seamlessly; 
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e Matt echoed Nim and mentioned the need for cost control; collaboration has improved significantly; we can 
be brutally honest with each other internally and have a united front; need to sell the Theranos/Walgreens 
value prop; 


Current Status: 
1. 30 stores currently live (AZ 29; CA 1) 
2. wave 4 launch dates — Aug 19 and Aug 26 — stores TBD 
3. total visits in July — 2637 
4. 27 out of 30 stores on DSL; Wave 4 wiring complete 
5. TIFT team performing 65% of oversight visits 
6. mostly improved patient experience 
7. median check in time = 5 min -— decr 1 min 
8. median wait time = 7 min — incr 1 min 
9. median perform time = 5 min — decr 2 min 
10. total visit time = 17 min — decr 2 min 

e Medicare/Medicaid now considers Theranos a large lab with 40 locations 

e Theranos will send computer next week for reporting portal 

e Passed 50% threshold of services provided to customers without using coupons 

e Theranos Experience Survey Summary results are off the charts; Nim asked for month to month trending 
reports; these are currently not available on the reporting dashboard; the data is collected real time and can 
be made available to Walgreens; Matt requested exception reporting, including where the extremes are; 
need to understand if the same techs are performing the service; Sunny offered raw data dump; Walgreens 
would love to have this info to slice and dice; 

e Baseline info provided where customers typically get their prescriptions filled; this is patient acquisition 
info; need to identify synergies; per Nim, important to get segment of the 47% that don’t use Walgreens to 
fill scripts; 

e Theranos is going to start collecting how many lab visits that patients get per year; 

e Shared several stories re: positive feedback from customers; moving patient experience from negative to 
positive; 30-40 positive comments per day; these comments can be tied back to the technician based on time 
of day; 

e Tracy shared shortest visit times; kudos to getting directions to the field on how to handle flow of patients 
during flu season; will continue to monitor wait time; can we handle 25 patients per day during flu season? 
We need to plan for that; 

e Nim and Suzanne Hansen are meeting with legal team on Wednesday to use clinic rooms agnostically for 
any service; will send out an update after the meeting; 

e Longest visit times may be due to new store rollout; each store needs to learn how to manage their own 
patient flow; per Sunny, look at wait and perform time together; 

e Nim experienced both a venous draw and finger stick and it went seamlessly, but waited for 16 minutes 
due to space allocation; need to get a handle on space allocation; Nim commented that patients abandon 
less services if health guide is in that location; Sunny looks forward to the day where lab services will be 
included in queue management; this is included in Phase 3 and needs to be expedited; 

e Per Joe, out of store marketing will launch next week, how soon do we anticipate that will impact patient 
volume in stores; Per Casey, need to have lab order, but it will be top of mind the next time they get a lab 
order; 

e Per Matt, do we need to re-visit getting the bot out of the room; Tracy has been following up to make sure 
that the door is open, not closed; Casey has not seen any doors closed, but every time they are sitting in the 
room; guidelines for bots are to walk around for 10 minutes out of every hour with tear sheets; Ops 
Managers will be in the stores constantly and will build relationships within the stores; 
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e Per Sunny, post 40 store launch would like to have Theranos to be completely out of the stores; need to plan 
for this; 

e Per Casey; phlebotomist/health guide position was posted on 7/31 for store #6241; all techs will be trained; 
store has a budget of 40 hours for techs; backfill with bots if required; TIFT team will prioritize off hours 
oversight training; low volume store = 100 scripts; person should be there start to end of pharmacy hours (9 
am-5 pm); Tuesday — Saturday; trained tech to cover on Monday; hope to get learnings from this store for 
future plans; 

e Opportunities: 

1. scalable strategy for check in (how to do check in at perform room or multiple terminals for check 
in at Pharmacy; nuance is that they will have to pay at the counter; mobile app could collect credit 
card payments; cash payments would go to Pharmacy; results could be held if payment doesn’t 
happen; per Mahesh, 5 stores will pilot additional check in terminals; equipment will be tight in 
those spaces;) 

2. store by store — start with stores with 10+ patients per day 

must start in August - will be tested during flu season 

4. tight integration between HCC and Theranos check-in (per Mahesh, take a look at HCC check in 
process for additional integration opportunities; per Nick, 3464 and 3789 have HCC integration and 
will be turned on for remaining 20 stores asap;) 

5. call center knowledge of Theranos and communication to patients (combined FAQ document sent 
to Call Center folks and provided key taglines) 

6. assurance that 40% of stores will be dedicated space (contractual agreement; Sunny will discuss 
with Nim; per Casey, Well Experience has better labor and better outcomes, so recommend 
following Well Experience in the future; this will be a shared space, not dedicated; if we have 25 
patients per day, the room will be in use all day; need to think ahead for 40 patients; Casey 
requested to take offline to solve considering real estate constraints we have today;) 

7. improved staffing in all stores — surprises with Theranos tech shortages need to be minimized 

8. need improvement in attentiveness of some stores 

9. cleaning 

10. attention to process — including opening and closing procedures 

11. managing flow of patients 

e Per Matt Sesto, need to follow up on which stores have medical concierge. May need to educate 1-2 people 
on directing patients to the right place. 

e Per Matt Sesto, take Playbook we have with instructions for HCC and replace with Theranos to improve 
store walks. 

e Per Casey, consider reducing hours on weekends where we are not seeing patients. Per Sunny, could inch 
back 1 hour. Would like to have learnings September —-December before making changes. 

e Per Tracy, working to get info to stores on when refrigerator logging is not taking place. Some stores are 
stepping up and able to monitor close process. 

e Per Mike, need to reinforce people readiness/ownership and accountability. Working to establish store 
champions. 

e Ops Managers will be people managers for bots and relationship managers for stores. 

e Per Sunny, working to educate that we are operating a lab operation and a store operation. 

e Per Ashley, CMS surveyors may arrive at any moment and could impose sanctions if applicable. 

e Per Matt, there are discussions on Walgreens side re: shared vs. dedicated space. Matt was not aware of 
40% contractual agreement re: dedicated space. 

e Per Tracy, there are discussions on Theranos side re: how supplies are set up. 

e Per Mahesh, Walgreens owns the rooms and are on the hook to make sure it is clean. 

e Per Joe, need to have a turnkey solution to maintain what has been launched. 

e Certification Maintenance proposal: 


ad 
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1. Criteria for removal of Certification 
* <80% finger stick proficiency (Bi-Monthly) 
« Acting against established procedures (As reported) 
What happens next? 
* Technician becomes Check-In ONLY 
" Lead time to remove technician from live patient perform workflow (?) 
3. Reinstate Certification 
« Assess trainee using original oversight standards 
« At least 2 consecutive successful end-to-end visits 
4. Idle Technicians 
* Technicians who perform <5 finger sticks in a given timeframe are required to complete 
practice finger sticks 

e Tracy discussed person who went on maternity leave that had to go through new hire training again. Tracy 
struggles if the person is shaking while they are performing the service. 

e Nim asked how new employees are trained. Ongoing training schedules are now available. Per Mike, 
ideally 2-3 months after hired would be a good time to send them to Theranos training. Lab testing is part 
of the job description nation-wide. Training will be batched based on need and periodic scheduling. Per 
Casey, TIFT team will be needed. Leads can assist with training. Store champion can provide fingers for 
practice. Per Nim, need clearly articulate process flows for new hires, rehires, etc. Per Brian, need 
consistency across the company on how certification maintenance will be handled upfront. 

e Action Item: work with Averill Gordon and HR Employee Relations to create a step approach process 
similar to how we handle prescription errors. Per Casey, when an event occurs, there needs to be an 
intervention. The first time an event occurs, the intervention may be a conversation. The second time an 
event occurs, appropriate steps will need to be taken. 

e Action Item: need to work with Priya Jagannathan to outline process flow for how to handle employees 
that cannot participate in Theranos services and may need to be transferred. 

e Action Item: per Nim, add Priya Jagannathan on the phone during Partnership meetings. 


N 


Program Measures of Success (SMART Goals): 

e Per Brian, how do we make the most of patients who are walking through our door? Casey cautions 
against providing scripts to employees because it comes across as being not genuine. Per Nim, scripting is 
being done to cross sell patients on other services. 

e All ofthe patient experience scores would be shared with stores via dashboard green/yellow/red model. 

e Wecan do Survey Monkey at store level directly to technicians. Matt Sesto is willing to sponsor. Guidance 
is to keep it brief. 

e Per Matt, would like to collaborate with Theranos re: Mercy Family Care sales discussions. 


STD Testing 
e Realigned with clinicians on HCC re: quality of testing; 

e Pat will lead small group including Monica Kohler and Kristen Hall to review any clinical issues. 

e Pat needs a point person from Theranos to provide expedited response to issues. Daniel Young 
was assigned by Sunny. 

e Angela Bankston and Dawn Benz have stepped down from this process. 

e Sunny would like to provide educational material to nurses in the field. 

e Call scheduled today to reengage the hearts and minds of HCC employees. 

e Results will always be different between two labs. 

e Need to address urban myth re: tests done on small number (20) of patients, not thousands of 
assays. 
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e Proficiency testing will be done through CAP. 
e Theranos is eager to detail NPs one-on-one. 
e HCC is rolling out STI protocol based evaluation testing nation-wide and will use Theranos panel in Phoenix. 
e There was a high incidence of male UTIs that were being turned away that were actually STDs. 
Turning away 1 patient per day. Would like to see 1 patient bump per day. Need to make HCC’s 
EBIT accretive. 
e Results would need to be provided faster than LabCorp and/or Quest. 
e Theranos can turnaround samples within lhour after it reaches the lab. 
e Most tests would be done via urine collection. 
e Nurses are already trained on venous draws and could use pediatric tubes with butterfly needles. 
e Weare well down the road with protocol. Johns Hopkins has already sprinkled the magic dust on 
the protocol. 
e Nim recommended that this also be offered to Johns Hopkins. 
e Dr. Connell’s vision is $50 visit with NP and $35 test with Theranos. This gets around concerns 
with confidentiality and cost, for example the 20-21 year old will not go on their parent's insurance. 
e Per Sunny, dropping price of Chlamydia/Gonorrhea to $30 next week. 
e Would like to do for a month in Phoenix and then rollout nationally. 
e There could be a script involved. Holy grail. 
e HCC could be ready in September. Theranos is ready now. They are launching sales to physicians 
next week. 
e Dr. Connell would like an HCC to be within 2-3 miles of Arizona State University. This is an 
opportunity for us. 
e #11610 on Mill is the current store that is located close to ASU. 
e Per Ashley, could zpack be moved to Prescription Savings Club to make it more affordable? 
e Kimsuggests adding a store near ASU at McClintock. 
e Per Matt, need to take offline Tucson value prop due to UofA out of network. 
e Per Nim, target 10/1 to launch Johns Hopkins. Per Sunny, could use Vacutainer on 9/1 and move to 
finger stick on 11/1. 
e IV drug users need the full STI panel. Protocol would have questions that would lead patients to 
full STD panel, if applicable. 
e Mayor Stanton is very passionate re: HIV. This is a press opportunity. 
e Next Steps: 
1. Pat will keep us updated re: protocol. 
2. Pat needs to follow up with Suzanne Hansen re: store 11610. 
3. Nim will follow up with Harry Leider re: Johns Hopkins opportunity. 
4. Patty to notify Marketing team that content needs to be updated. Include this in August 
launch. 
Pat will send protocol to Sunny for review. 
6. Theranos to simplify EMR. 


or 


Plan for FY15 
e Next market is Northern CA (5 stores initially, then expand for a total of 40) 
e Expansion beyond the 5 stores will require Theranos data to obtain store selection 
e Next markets: 
o Priority 1: 
» CA -~ blue (~90) — toughest regulations 


# AZ (~20) 
» NY, NJ, CT - blue (~90) - toughest audits 
» WY? 
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o Priority 2: 


» IL-blue 
» TX-red 
s FL 
o Priority 3: 
» IN 
» NM- blue 
=» MS-red 


o Excluded PA 
e Plan for FY15 is to follow the Well Experience rollout as much as possible. 
o Keeps build-out costs low 
o WE personnel are often a good fit for Theranos services. 
e Initial goal for FY15 (Sept-Aug) was 500 stores. Need to redefine this goal. 
o Nation-wide = 2000-2500 stores and 25-30 MSAs 
o Assumes launch in parallel markets 
o Need to figure out “launch in a box” concept 
o Plan to be in every HCC location 


2015 2016 (outside US) 2017 
Well Experience 2000 2000 | 1500 
Theranos 200 800 800 
STD Program at HCC 430 existing + 50 new +150 new +300 new 


e Next Steps: 

Criteria alignment, e.g. clinic, WE, etc. 

Get list of 2,000 stores with PHRs 

Get list of WE stores within those states 

Need to follow up on WY due to 12 stores 

Review Field Webinar content 

6. Identify owners for CA leadership kickoff meeting 


Soe NS 


Key Anchors Discussion (prioritized order) 
Patient Experience (scalable & standardized) 
Partner Relationship 
Pharmacy Transformation 
Add clinic leadership to key stakeholders, including Pat Carroll, Suzanne Hansen, and Chief Nurse 
Practitioner (to be named) 
e Theranos, Well Experience, HSRx, and Clinics are to priorities for the company; 3 out of 4 are represented on 
the Theranos initiative; 
e Next Steps: 
1. Conduct Do/Say/Own exercise with Nim & Sunny 
2. Execute Against Change Management Action Planning Exercise Results 
3. Leveraging Key Anchors and Action Planning Exercise Results, Finalize FY15 Change Strategy Draft 
4. Socialize FY15 Change Strategy 
Future meeting schedule: 
e 10/2, 1-5 pm, Deerfield, IL; 
e 10/24, 8:30 am - 12:30 pm, Phoenix, AZ; 
e 11/18, 8 am—12 pm, Palo Alto, CA; 
e 12/16,8 am-— 12 pm, Palo Alto, CA; 


eons 
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Theranos/WAG Leadership 


Mid-wave Partnership 
Debrief 


ee =: Tracy Masson, Christian Holmes, Kimberly 
ome Sunny Balwani, Nimesh Jhaveri, Casey 
Kozlowski, Nick Menchel, Joe Ahdoot, Max Fosque, 
Ashley Samoila, Matt Sesto, Brian Sizemore, Ryan 
-Karpel, Mahesh Raju, Mike Lewis, Pat Carroll, Patty 

- Haworth 


Kick-off/Introductions Sunny/Nimesh 9-9:10 am 

Current Status Sunny/Nimesh 9:10-9:30 am 
Discuss Anchored Values Mike Lewis 9:30-10:00 am. 
Discuss Program Measures of Success (GMART Goals) Nimesh 10:00-11:00 am 
Plan for FY15 Casey 11:00-11:30 am 
California Plans Sunny/Nimesh 11:30-11:45 am 
STD Testing - review the new structure of quality reporting Pat Carroll 11:45 am-12:00 pm 


from the HealthCare Clinic 
Lunch All 12:00-1:00 pm 


Kickoff: 


Confidential 


Sunny kicked off the meeting 

Momentum is building and patient uptick is occurring 

Met 3 times in a row (5/28, 7/10, 8/7); next meeting is 10/2 in Deerfield; 

Nim commented on a big day for Walgreens to focus us even harder for what is next to focus on initiatives 
to drive value to Walgreens, our partners, and US health system 

The project team is in the process of putting together a clearly articulated playbook, including people 
preparedness, marketing, operations, launch plans, etc. 

Success has been through sheer muscle; we need to make it a seamless operation; if everyone went on 
vacation at the same time, we need to make sure operations are running seamlessly; 

Matt echoed Nim and mentioned the need for cost control; collaboration has improved significantly; we can 
be brutally honest with each other internally and have a united front; need to sell the Theranos/Walgreens 
value prop; 
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Current Status: 

30 stores currently live (AZ 29; CA 1) 

wave 4 launch dates — Aug 19 and Aug 26 — stores TBD 

total visits in July — 2637 

27 out of 30 stores on DSL; Wave 4 wiring complete 

TIFT team performing 65% of oversight visits 

mostly improved patient experience 

median check in time = 5 min — decr 1 min 

median wait time = 7 min — incr 1 min 

median perform time = 5 min — decr 2 min 

10. total visit time = 17 min — decr 2 min 

e Medicare/Medicaid now considers Theranos a large lab with 40 locations 

e Theranos will send computer next week for reporting portal 

e Passed 50% threshold of services provided to customers without using coupons 

e Theranos Experience Survey Summary results are off the charts; Nim asked for month to month trending 
reports; these are currently not available on the reporting dashboard; the data is collected real time and can 
be made available to Walgreens; Matt requested exception reporting, including where the extremes are; 
need to understand if the same techs are performing the service; Sunny offered raw data dump; Walgreens 
would love to have this info to slice and dice; 

e Baseline info provided where customers typically get their prescriptions filled; this is patient acquisition 
info; need to identify synergies; per Nim, important to get segment of the 47% that don’t use Walgreens to 
fill scripts; 

e Theranos is going to start collecting how many lab visits that patients get per year; 

e Shared several stories re: positive feedback from customers; moving patient experience from negative to 
positive; 30-40 positive comments per day; these comments can be tied back to the technician based on time 
of day; 

e Tracy shared shortest visit times; kudos to getting directions to the field on how to handle flow of patients 
during flu season; will continue to monitor wait time; can we handle 25 patients per day during flu season? 
We need to plan for that; 

e Nim and Suzanne Hansen are meeting with legal team on Wednesday to use clinic rooms agnostically for 
any service; will send out an update after the meeting; 

e Longest visit times may be due to new store rollout; each store needs to learn how to manage their own 
patient flow; per Sunny, look at wait and perform time together; 

e Nimexperienced both a venous draw and finger stick and it went seamlessly, but waited for 16 minutes 
due to space allocation; need to get a handle on space allocation; Nim commented that patients abandon 
less services if health guide is in that location; Sunny looks forward to the day where lab services will be 
included in queue management; this is included in Phase 3 and needs to be expedited; 

e Per Joe, out of store marketing will launch next week, how soon do we anticipate that will impact patient 
volume in stores; Per Casey, need to have lab order, but it will be top of mind the next time they get a lab 
order; 


SANA FON 


e Per Matt, do we need to re-visit getting the bot out of the room; Tracy has been following up to make sure 
that the door is open, not closed; Casey has not seen any doors closed, but every time they are sitting in the 
room; guidelines for bots are to walk around for 10 minutes out of every hour with tear sheets; Ops 
Managers will be in the stores constantly and will build relationships within the stores; 

e Per Sunny, post 40 store launch would like to have Theranos to be completely out of the stores; need to plan 
for this; 

e Per Casey; phlebotomist/health guide position was posted on 7/31 for store #6241; all techs will be trained; 
store has a budget of 40 hours for techs; backfill with bots if required; TIFT team will prioritize off hours 
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oversight training; low volume store = 100 scripts; person should be there start to end of pharmacy hours @ 
am-5 pm); Tuesday — Saturday; trained tech to cover on Monday; hope to get learnings from this store for 
future plans; 

e Opportunities: 

1. scalable strategy for check in (how to do check in at perform room or multiple terminals for check 
in at Pharmacy; nuance is that they will have to pay at the counter; mobile app could collect credit 
card payments; cash payments would go to Pharmacy; results could be held if payment doesn’t 
happen; per Mahesh, 5 stores will pilot additional check in terminals; equipment will be tight in 
those spaces;) 

2. store by store — start with stores with 10+ patients per day 

must start in August - will be tested during flu season 

4. tight integration between HCC and Theranos check-in (per Mahesh, take a look at HCC check in 
process for additional integration opportunities; per Nick, 3464 and 3789 have HCC integration and 
will be turned on for remaining 20 stores asap;) 

5. call center knowledge of Theranos and communication to patients (combined FAQ document sent 
to Call Center folks and provided key taglines) 

6. assurance that 40% of stores will be dedicated space (contractual agreement; Sunny will discuss 
with Nim; per Casey, Well Experience has better labor and better outcomes, so recommend 
following Well Experience in the future; this will be a shared space, not dedicated; if we have 25 
patients per day, the room will be in use all day; need to think ahead for 40 patients; Casey 
requested to take offline to solve considering real estate constraints we have today;) 

7. improved staffing in all stores — surprises with Theranos tech shortages need to be minimized 

8. need improvement in attentiveness of some stores 

9. cleaning 

10. attention to process — including opening and closing procedures 

11. managing flow of patients 

e Per Matt Sesto, need to follow up on which stores have medical concierge. May need to educate 1-2 people 
on directing patients to the right place. 

e Per Matt Sesto, take Playbook we have with instructions for HCC and replace with Theranos to improve 
store walks. 

e Per Casey, consider reducing hours on weekends where we are not seeing patients. Per Sunny, could inch 
back 1 hour. Would like to have learnings September ~-December before making changes. 

e Per Tracy, working to get info to stores on when refrigerator logging is not taking place. Some stores are 
stepping up and able to monitor close process. 

e Per Mike, need to reinforce people readiness/ownership and accountability. Working to establish store 
champions. 

e Ops Managers will be people managers for bots and relationship managers for stores. 

e Per Sunny, working to educate that we are operating a lab operation and a store operation. 

e Per Ashley, CMS surveyors may arrive at any moment and could impose sanctions if applicable. 

e Per Matt, there are discussions on Walgreens side re: shared vs. dedicated space. Matt was not aware of 
40% contractual agreement re: dedicated space. 

e Per Tracy, there are discussions on Theranos side re: how supplies are set up. 

e Per Mahesh, Walgreens owns the rooms and are on the hook to make sure it is clean. 

e Per Joe, need to have a turnkey solution to maintain what has been launched. 

e Certification Maintenance proposal: 

1. Criteria for removal of Certification 
* <80% finger stick proficiency (Bi-Monthly) 
* Acting against established procedures (As reported) 
2. What happens next? 


a 
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* Technician becomes Check-In ONLY 
* Lead time to remove technician from live patient perform workflow (?) 
3. Reinstate Certification 
* Assess trainee using original oversight standards 
* At least 2 consecutive successful end-to-end visits 
4. Idle Technicians 
* Technicians who perform <5 finger sticks in a given timeframe are required to complete 
practice finger sticks 

e Tracy discussed person who went on maternity leave that had to go through new hire training again. Tracy 
struggles if the person is shaking while they are performing the service. 

e Nim asked how new employees are trained. Ongoing training schedules are now available. Per Mike, 
ideally 2-3 months after hired would be a good time to send them to Theranos training. Lab testing is part 
of the job description nation-wide. Training will be batched based on need and periodic scheduling. Per 
Casey, TIFT team will be needed. Leads can assist with training. Store champion can provide fingers for 
practice. Per Nim, need clearly articulate process flows for new hires, rehires, etc. Per Brian, need 
consistency across the company on how certification maintenance will be handled upfront. 

e Action Item: work with Averill Gordon and HR Employee Relations to create a step approach process 
similar to how we handle prescription errors. Per Casey, when an event occurs, there needs to be an 
intervention. The first time an event occurs, the intervention may be a conversation. The second time an 
event occurs, appropriate steps will need to be taken. 

e Action Item: need to work with Priya Jagannathan to outline process flow for how to handle employees 
that cannot participate in Theranos services and may need to be transferred. 

e Action Item: per Nim, add Priya Jagannathan on the phone during Partnership meetings. 


Program Measures of Success (SMART Goals): 

e Per Brian, how do we make the most of patients who are walking through our door? Casey cautions 
against providing scripts to employees because it comes across as being not genuine. Per Nim, scripting is 
being done to cross sell patients on other services. 

e All ofthe patient experience scores would be shared with stores via dashboard green/yellow/red model. 

e We can do Survey Monkey at store level directly to technicians. Matt Sesto is willing to sponsor. Guidance 
is to keep it brief. 

e Per Matt, would like to collaborate with Theranos re: Mercy Family Care sales discussions. 


STD Testing 
e Realigned with clinicians on HCC re: quality of testing; 
e Pat will lead small group including Monica Kohler and Kristen Hall to review any clinical issues. 
e Pat needs a point person from Theranos to provide expedited response to issues. Daniel Young 
was assigned by Sunny. 
e Angela Bankston and Dawn Benz have stepped down from this process. 
e Sunny would like to provide educational material to nurses in the field. 
e Call scheduled today to reengage the hearts and minds of HCC employees. 
e Results will always be different between two labs. 
e Need to address urban myth re: tests done on small number (20) of patients, not thousands of 
assays. 
e Proficiency testing will be done through CAP. 
e Theranos is eager to detail NPs one-on-one. 
e HCC is rolling out STI protocol based evaluation testing nation-wide and will use Theranos panel in Phoenix. 
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e There was a high incidence of male UTIs that were being turned away that were actually STDs. 
Turning away 1 patient per day. Would like to see 1 patient bump per day. Need to make HCC’s 
EBIT accretive. 

e Results would need to be provided faster than LabCorp and/or Quest. 

e Theranos can turnaround samples within lhour after it reaches the lab. 

e Most tests would be done via urine collection. 

e Nurses are already trained on venous draws and could use pediatric tubes with butterfly needles. 

e Weare well down the road with protocol. Johns Hopkins has already sprinkled the magic dust on 
the protocol. 

e Nim recommended that this also be offered to Johns Hopkins. 

e Dr. Connell’s vision is $50 visit with NP and $35 test with Theranos. This gets around concerns 
with confidentiality and cost, for example the 20-21 year old will not go on their parent’s insurance. 

e Per Sunny, dropping price of Chlamydia/Gonorrhea to $30 next week. 

e Would like to do for a month in Phoenix and then rollout nationally. 

e There could be a script involved. Holy grail. 

e HCC could be ready in September. Theranos is ready now. They are launching sales to physicians 
next week. 

e Dr. Connell would like an HCC to be within 2-3 miles of Arizona State University. This is an 
opportunity for us. 

e #11610 on Mill is the current store that is located close to ASU. 

e Per Ashley, could zpack be moved to Prescription Savings Club to make it more affordable? 

e Kim suggests adding a store near ASU at McClintock. 

e Per Matt, need to take offline Tucson value prop due to UofA out of network. 

e Per Nim, target 10/1 to launch Johns Hopkins. Per Sunny, could use Vacutainer on 9/1 and move to 
finger stick on 11/1. 

e IV drug users need the full STI panel. Protocol would have questions that would lead patients to 
full STD panel, if applicable. 

e Mayor Stanton is very passionate re: HIV. This is a press opportunity. 

® Next Steps: 

1. Pat will keep us updated re: protocol. 

2. Pat needs to follow up with Suzanne Hansen re: store 11610. 

3. Nim will follow up with Harry Leider re: Johns Hopkins opportunity. 

4. Patty to notify Marketing team that content needs to be updated. Include this in August 
launch. 

Pat will send protocol to Sunny for review. 

6. Theranos to simplify EMR. 


oI 


Plan for FY15 
e Next market is Northern CA (5 stores initially, then expand for a total of 40) 
e Expansion beyond the 5 stores will require Theranos data to obtain store selection 
e Next markets: 
o Priority 1: 
* CA - blue (~90) — toughest regulations 


» AZ (~20) 
» NY, NJ, CT — blue (~90) — toughest audits 
= WY? 
o Priority 2: 
» IL-blue 
» TX-red 
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= FL 
o Priority 3: 
» IN 
= NM- blue 
= MS- red 


o Excluded PA 
e Plan for FY15 is to follow the Well Experience rollout as much as possible. 
o Keeps build-out costs low 
o WE personnel are often a good fit for Theranos services. 
e Initial goal for FY15 (Gept-Aug) was 500 stores. Need to redefine this goal. 
o Nation-wide = 2000-2500 stores and 25-30 MSAs 
o Assumes launch in parallel markets 
o Need to figure out “launch in a box” concept 
o Plan to be in every HCC location 


2015 2016 (outside US) 2017 
Well Experience 2000 2000 1500 
Theranos 200 800 800 
STD Program at HCC 430 existing + 50 new +150 new +300 new 


e Next Steps: 

Criteria alignment, e.g. clinic, WE, etc. 

Get list of 2,000 stores with PHRs 

Get list of WE stores within those states 

Need to follow up on WY due to 12 stores 

Review Field Webinar content 

6. Identify owners for CA leadership kickoff meeting 


ap ON 


Key Anchors Discussion (prioritized order) 
Patient Experience (scalable & standardized) 
Partner Relationship 
Pharmacy Transformation 
Add clinic leadership to key stakeholders, including Pat Carroll, Suzanne Hansen, and Chief Nurse 
Practitioner (to be named) 
e Theranos, Well Experience, HSRx, and Clinics are to priorities for the company; 3 out of 4 are represented on 
the Theranos initiative; 
e Next Steps: 
1. Conduct Do/Say/Own exercise with Nim & Sunny 
2. Execute Against Change Management Action Planning Exercise Results 
3. Leveraging Key Anchors and Action Planning Exercise Results, Finalize FY15 Change Strategy Draft 
4. Socialize FY15 Change Strategy 
Future meeting schedule: 
e 10/2, 1-5 pm, Deerfield, IL; 
e 10/24, 8:30 am - 12:30 pm, Phoenix, AZ; 
e 11/18, 8 am —12 pm, Palo Alto, CA; 
e 12/16,8 am —- 12 pm, Palo Alto, CA; 


ew Ne 
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To: Sunny Balwani[sbalwani@theranos.com] 
From: Jhaveri, Nimesh 
Sent: Wed 8/13/2014 9:45:08 PM 


Importance: Normal 
Subject: Re: store build out 
Received: Wed 8/13/2014 9:45:10 PM 


Hi Sunny — yes fully aware of the terms — we are determining the implications of this requirement..The best way to make this happen is to 
truly determine the store selection for the entire chain now, based on the criteria. We are going to touch 2000 stores in 2015 and would like 
to make sure we place 2 rooms in the stores that we want to select for Gold level. if you can finalize the store selection criteria by end of this 
week, it would be a tremendous help. 


Also, based on the contract terms, the 40% is an aggregate not necessarily by market. Thoughts? 


From: Sunny Balwani <sbalwani@theranos.com> 
Date: Tuesday, August 12, 2014 at 1:49 PM 

To: Nimesh Jhaveri <nimesh.jhaveri@walgreens.com> 
Subject: store build out 


Hey Nim. 

hope you are well. 

Can we touch base over next few days to chat about our Gold, Silver and Bronze store layouts and distribution. as you may know (may not 
know also), that in AZ and CA, at least 40% of the stores are to be Gold (dedicated Theranos rooms) so want to make sure we are tracking 


that. 


thanks. 
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Message 

From: Spitzer, Jonathan [jonathan.spitzer@walgreens.com] 

Sent: 3/30/2015 3:14:08 AM 

To: Jhaveri, Nimesh [nimesh.jhaveri@walgreens.com] 

ce: Reilly, Matthew [matthew.reilly@walgreens.com]; Bradshaw, Christopher [chris.bradshaw @walgreens.com]; 
Fluegel, Bradley [bradley.fluegel@walgreens.com]; Wasson, Stewart [brad.wasson@walgreens.com]; Reutzel, Erich 
[erich.reutzel@walgreens.com] 

Subject: RE: Theranos- time sensitive 


Team 2 let me know any revisions you would like before sending over to Alan tomorrow morning. The below write up is 


detailed, but | wanted to make sure Alan has all information up front. 


Please find attached a quick snapshot of the financial and operational performance of the Theranos pilot. Note that the 
financials attached reflect the current contract in place in which Walgreens is reimbursed $10.00 per patient as well as 
responsible for build out cost and providing labor for the service start to finish. Starting in February Theranos hired and 
staffed 40 / 41 locations with their Phlebotomists and Walgreens labor has been Hremovedtl from the stores. We are 
still performing check in for each of the Theranos diagnostic patients which takes on average ~6-7 minutes. | have not 
forested the change in labor at this time, but we should expect the project operational expenses to go from ~S100k a 
month to ~$20-40k per month. The new contract renegotiations are taking place and | have provided an executive 
summary below. 


Patients per day actuals versus expected ramp is trending slightly below budget the last couple of months. February was 
at 6.4 versus 6.6 patients per day and year to date average is at 4.9 versus 4.9. The business team believes this is due to 
holiday seasonal impacts to the diagnostic testing industry. We should see the patients per day trend up as Theranos 
just signed a lab testing deal with a major health system in AZ. Total patients ytd February is 36,324 versus budget 
36,162 which would translate to Revenue / GP of $363,240 versus $361,620. Full year forecast is 95,151 versus budget 
of 95,079 patients or $951,510 versus budget $950,790. 


As for the inquiry on the break even for the pilot to pay for our cost of capital, | can certainly model this out however the 
operations have changed significantly and therefore a forecasted new SG&A down to EBIT will not be comparable to 
budget or even what a future relationship could look like. What | do feel is helpful is some context around future 
Theranos fl Walgreens Boots Alliance relationship. With Theranos taking on build out capital costs and staffing 
Phlebotomist with Walgreens being liable for check in labor our goal would be to receive 3x rent and min. ~$8 patient 
which would translate to an EBIT of ~$125m a year at scale (2,501 locations and 22.5 patients per day). For every $1 
change in patient reimbursement would change the EBIT by $20m. Our new break even cost of capital 9% over 5 years, 
fiscal 2013 H 2017, would mean we have to receive 2x rent and $4.38 reimbursement per patient @ 8.1 patients per day 
in fiscal 2017. 


Negotiation Update 
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Thank you, 


Jay Spitzer 

Finance Manager 

Health Innovations Group 
Waigreen Co. 

200 Wilmot Rd 

Deerfield, [L 60015 

p 847-315-6465 

c 


get, stay and live weil. 


From: Jhaveri, Nimesh 

Sent: Sunday, March 29, 2015 8:56 PM 

To: Spitzer, Jonathan 

Cc: Reilly, Matthew; Bradshaw, Christopher; Fluegel, Bradley; Wasson, Stewart 
Subject: Re: Theranos- time sensitive 


Hi Jay - 


Please send to Brad and Brad before sending it to Alan. Thanks. 
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Many thanks, 
Nimesh 


Nimesh S. Jhaveri 
Walgreen Co. 

200 Wilmot Rd. 
Deerfield, IL 60015 
0 847-315-5317 

m 


On Mar 29, 2015, at 8:48 PM, Spitzer, Jonathan <jonathan.spitzer@walgreens.com> wrote: 
Matt thanks for forwarding on. 


ishould have all the information to answer Alan@s inquiries. [Ml put together tonight and get a draft ernail as well as 
backup to the team listed in this email. As an FYL Kalani was looking for similar information late Friday afternoon. 


Jay 


From: Reilly, Matthew 

Sent: Sunday, March 29, 2015 6:10 PM 

To: Spitzer, Jonathan; Bradshaw, Christopher 
Cc: Jhaveri, Nimesh 

Subject: Fwd: Theranos- time sensitive 


Jay 


| figure you probably have something pretty quick you can update and get out to Alan. | will let you know what time this 
is needed by. 


Sorry for the delay but | am just getting back to town and saw this a few minutes ago. 


Begin forwarded message: 

From: "Nielsen, Alan" <alan.nielsen@walereens.com> 

Date: March 29, 2015 at 12:37:22 PM CDT 

To: "Reilly, Matthew" <matthew.reilly@walgreens.com>, “Reutzel, Erich" <erich.reutzel@walgreens.com> 


Subject: Theranos- time sensitive 

Guys 

Can | get current performance on Theranos with a comparison to the model that supported decision or set expectations 
for the pilot (~40 locations)? | need this by tomorrow morning, unfortunately. Let me know what | can have by then... 
even if rough. 

Questions will be: 

Are we seeing the test quantity progression we expected. At the expected ramp, when would we see profit on a per 


Trial Exh. 02449 Page 003 
CONFIDENTIAL WG027147 


ER-5454 


Case: 22-10338, 05/04/2023, ID: 12709436, DktEntry: 22-21, Page 61 of 188 


location basis? What is the test per day quantity, and the time and location ramp to achieve, that would earn us our 
cost of capital? 

Available to talk today if that helps. 

Thanks 

atn 


Alan T. Nielsen 
Chief Financial Officer, Walgreen Co. 
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To: Elizabeth Holmes[eholmes@theranos.com] 
From: Chinmay Pangarkar 

Sent: Sat 8/16/2014 11:32:25 PM 

Importance: Normal 

Subject: ELISA update 

Received: Sat 8/16/2014 11:32:27 PM 

Hi Elizabeth: 


Please find ELISA updates below. Apologies for not sending you weekly updates as we had previously discussed. We also have an 
update meeting scheduled for monday where we can discuss things in greater detail. 


The efforts of the team are currently divided amongst the following 5 programs: 


1. Normandy assays on 3.5 (current and new) 
© Netra, Darren, Nahal, Emma, Chengang, Hao, Tiffany, Nili 
2. Assay integration on 4s+ 
© Jesisca, Laura, Sebastian, Salina, Uyen 
3. B-52 (HSV) 
© Jesisca, Laura, Sebastian, Salina, Uyen 
4. Magnetic bead-based ELISA 
© Ran, Sebastian 
5. pCTN studies 
© Samantha and Carmence 


1. Normandy ELISA assays on 3.5 
© SHBG and B12 are the most recent ones to go live 
© Next in line are the following. Please note that for all of the following assays, we have faced reproducibility issues. Also, we 
have modified our validation protocol to better support matrix comparison results. This has delayed the go-live, but will lead to 
fewer problems once the assays are live. 
« Estradiol: we finished redoing method comparison with in-house and CDC samples. We now have good confidence to 
take this assay live. This will go live midweek 8/20. 
« Prolactin: We repeated method comparison for this assay and were abie to demonstrate the validity of the bias 
correction. The reagent lot based changes are large enough so that every time we make a new lot, we will need to do an 
lQP. Assay should be live on 8/20. 
= PTH: we are wrapping up matrix comparison and will be taking the assay live on 8/20. 
" Folate: We will receive readers and cartridges on 8/18, wrap up the analyze stability studies by 8/21 and the assay 
should be live by the end of the week. (8/23). 
© The current assays which are live are also taking quite a lot of time from the team for the following issues: 
= hCG: we just established our ability to perform dilution for high hCG samples from women in 2nd trimester. 
* #14 and TSH: we have received many questions from physicians about the lack of correlation between these two 
analytes when measured with the Theranos assays. We have started running a combined IQP to identify the issues with 
these assays, if any. 
« TST: we are observing a high frequency of patients who have very high TST, which manifests in our assay as an 
INVALID flag. this requires CLIA to rerun the sample, and even after that we are not 100% sure about the result. We 
need to perform more studies to set the INVALID flag so that we minimize unnecessary reruns. 
" Syphillis RPR: After more than 5 different reformulations of the coating solution, Binh (with support from Sharada and 
Ran) was not able to get RPR tips coated with acceptable performance. We have decided to move the assay to 4s+ 
anyway, and so we will troubleshoot this directly on minitips. But over the last 3 months, we have spent a significant 
amount of time working on this. 
© Progesterone: this is assay is currently in validation. We do not have sufficient sensitivity at the low end, as compared to the 
immulite. This causes the method comparison to not be linear. We have not encountered any situation like this in the past. We 
are barely passing method comparison right now. | have concerned about this assay at the low end, but we will find out more 
in the next 2 weeks. 
© Free T3: We have very promising clinical correlation as of today. Both the key reagents : T3 phosphorylase (surface) and 
Ab-AP conjugate are made in house by Wing. So far we have been evaluating test batches and communicating performance 
of these to him which he then uses to tweak the reagent some more. Before we move to validation we will need to evaluate 3 
lots of material and be assured of performance but | am encouraged that now the data looks promising and we can push on 
this. 
© HIV1/2: We have worked out the HIV 2 third generation assay format and have promising data. HIV 71 continues to be an 
issue we are awaiting more antigen AP conjugates from chemistry group and binders and are working together with both 
teams to figure this out. We are also working on 4" generation tests for both HIV1 /2. 
2. Assay integration on 4s+: 
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© This program encompasses STI panel as well as the next set of pain-rank assays (LH, FSH, fPSA, DHEAS etc). Currently, 
we have not been able to move all the resources to this project since there are no 4s+ devices available. 

© We have created and tested protocols for almost of these assays so that we will be able to start as soon as we start getting 
devices. 

© We have also starting preparing reagents for tip coating etc for all these assays which should be ready by 8/27. Given that 
we will be device limited, we will have to split the group into shifts so as to maximize device usage. 


3. B-52 (HSV): 


© This project is currently taking most of the resource time since we are in the process of trying out a wide variety of assay 
conditions. Jessica, Laura, Sebastian, Salina and Uyen are involved pretty much full-time in this project, and whatever free 


time they have is being used for STI and pain rank assay work. 
© We expect that by 8/21, | will be able to take most of the resources off of full time B-52 duty. They will be signing up for B-52 


twice a week. This will give us more time to spend on STI and pain rank assays. 


4. Magnetic bead based ELISA: 


° Gary has sent out his initial proof-of-concept. The data are promising, with 10-14% CV across readers. There is a lot of 
room for improvement and we will be meeting on this on monday. In parallel, Yiching has also started brain-storming certain 
ideas on performing magnetic bead assays without the magnetic card as we discussed. We will be laying out the best 
approach based on integrating the feedback we get from Gary. | will have a better idea about the timeline only after we go 
through this process. 
© In parallel, Ran and Sebastian have obtained all the materials to perform these assays on the bench. they will have initial 
results by the end of next week (8/22), showing precision and modulation for the MTP-beads model. This model will be purely 
manual to begin with. We have also ordered the plate washer and incubator from TECAN (loaners) so that this process can be 
automated. We don’t have an ETA for these equipment yet. 
° The goal for the magnetic bead ELISA project are the following, per our discussion: 

« demonstrate best performance using on-bench approach by 9/14 

= demonstrate proof of concept for performing these assays using magnetic-card-independent operation on 4s+ by 

9/14. 


5. pCTN studies: 


thanks 


Chinmay 


© We have the FDA study ongoing. Samantha Z and Carmence are working on this study. The study will take 60% of the 
teams time until end of august, at least. 
© We have more studies coming up for Debbie’s next pCTN version. 


From: Elizabeth Holmes 
Sent: Saturday, August 16, 2014 3:36 PM 
To: Chinmay Pangarkar 


Subject: 


What is the ELISA development status? How many assays total (and how many new) will be up by end of month? What is going on 
with the magnetic bead project? Please start sending me daily updates on ELISA now 
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DEPARTMENT OF HEALTH & HUMAN SERVICES 
Centers for Medicare & Medicaid Services 

Western Division of Survey and Certification 

San Francisco Regional Office 

90 7 Street, Suite 5-300 (5W) 

San Francisco, CA 94103-6707 


os CENTERS FOR MEDICARE & MEDICAID SERVICES 


Refer to: WDSC- GKY 


IMPORTANT NOTICE — PLEASE READ CAREFULLY 
January 25, 2016 


Sunil Dhawan, M.D., Director CLIA Number: 05D2025714 
Theranos, Inc. 

7333 Gateway Boulevard 

Newark, CA 94560 


RE: CONDITION LEVEL DEFICIENCIES — IMMEDIATE JEOPARDY 
Dear Dr. Dhawan: 


In order for a laboratory to perform testing under the Clinical Laboratory Improvement 
Amendments of 1988 (CLIA), Public Law 100-578, it must comply with all CLIA requirements. 
These requirements are found in section 353 of the Public Health Service Act (42 U.S.C. 263a) 
and 42 Code of Federal Regulations, Part 493 (42 CFR 493). Federal regulations require onsite 
surveys to determine whether or not a laboratory is in compliance with the applicable regulations. 
Compliance with these regulations is a condition of certification for the CLIA program. 


The Centers for Medicare & Medicaid Services (CMS) conducted a CLIA recertification and 
complaint survey of the laboratory. The onsite survey was completed on November 20, 2015. 
However, the survey concluded with the receipt of critical information received from the 
laboratory on December 23, 2015. As a result of the survey, it was determined that your facility 
is not in compliance with all of the Conditions required for certification in the CLIA program. In 
addition, based on the Condition-level requirement at 42 C.F.R. § 493.1215, Hematology, it was 
determined that the deficient practices of the laboratory pose immediate jeopardy to patient health 
and safety. (Immediate jeopardy is defined by the CLIA regulations as a situation in which 
immediate corrective action is necessary because the laboratory’s non-compliance with one or 
more Condition-level requirements has already caused, is causing, or is likely to cause, at any time, 
serious injury or harm, or death, to individuals served by the laboratory or to the health and safety 
of the general public.) Specifically, the following Conditions were not met: 


D5024: 42 C.F.R. § 493.1215 Condition: Hematology; 
D5400: 42 C.F.R. § 493.1250 Condition: Analytic systems; 


D6076: 42 C.F.R. § 493.1441 Condition: Laboratories performing high Coreen) 


testing; laboratory director; 


D6108: 42 C.F_R. § 493.1447 Condition: Laboratories performing high sonia 


testing; technical supervisor; and, 
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D6168: 42 C.F.R. § 493.1487 Condition: Laboratories performing high complexity 
testing; testing personnel. 


In addition, other standards were also found to be not met. Enclosed is Form CMS-2567, 
Statement of Deficiencies, listing all the deficiencies found during the survey. 


When a laboratory’s deficiencies pose immediate jeopardy, CMS requires the laboratory to take 
immediate action to remove the jeopardy and come into Condition-level compliance. Laboratories 
that do not meet the Condition-level requirements of CLIA may not be certified to perform 
laboratory testing under the CLIA program. 


The laboratory has 10 CALENDAR DAYS from the date of receipt of this notice to provide CMS’ 
Central Office and San Francisco Regional Office with a credible allegation of compliance and 
acceptable evidence of correction documenting that the immediate jeopardy has been removed and 
that action has been taken to correct all of the Condition-level deficiencies in question. 


Please document the laboratory’s allegation of compliance using the enclosed Form CMS-2567, 
Statement of Deficiencies, in the columns labeled “Provider Plan of Correction” and “Completion | 
Date” located on the right side of the form, keying your responses to the deficiencies on the left. | 
The laboratory director must sign, date and return the completed Form CMS-2567 documented 
with a credible allegation of compliance WITHIN 10 CALENDAR DAYS from the date of receipt 

of this notice. You must also submit documented evidence that verifies that the corrections were 

made. (Your allegation of compliance will be included in the public record of the inspection.) 


For your information, a credible allegation of compliance is a statement or documentation that is: 


1) Made by a representative of a laboratory with a history of having maintained a 
commitment to compliance and taking corrective action when required; 


2) Realistic in terms of the possibility of the corrective action being accomplished between 
the date of the survey and the date of the allegation; and 


3) Indicates resolution of the problems. 
In addition, acceptable evidence of correction must include: 


1) Documentation showing what corrective action(s) have been taken for patients found 
to have been affected by the deficient practice; 


2) How the laboratory has identified other patients having the potential to be affected by 
the same deficient practice and what corrective action(s) has been taken; 


3) What measure has been put into place or what systemic changes have been made to 
ensure that the deficient practice does not recur; and 
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4) How the corrective action(s) are being monitored to ensure the deficient practice does 
not recur. 


If the laboratory submits a credible allegation of compliance and acceptable evidence of correction 
that the laboratory has removed jeopardy and come into Condition-level compliance, and we are 
able to verify compliance with all CLIA requirements through a follow-up survey, sanctions will 
not be imposed. If the laboratory does not submit a credible allegation of compliance and 
acceptable evidence of correction, we will not conduct a follow-up survey. 


If jeopardy is not removed and the laboratory does not come into Condition-level compliance, 
CMS will take sanction action(s) against the laboratory’s CLIA certificate. If necessary, we will 
advise the laboratory in writing of the sanction(s) to be imposed and/or enforcement action(s) that 
will be taken. These sanctions may include alternative sanctions (Civil Money Penalty of up to 
$10,000 per day of non-compliance pursuant to 42 C.F.R. §493.1834, Directed Plan of Correction 
pursuant to 42 C.F.R. § 493.1832, and/or State Onsite Monitoring pursuant to 42 C.F.R. § 
493.1836) and principal sanctions (suspension, limitation and/or revocation of the laboratory's 
CLIA certificate and cancellation of the laboratory's approval for Medicare payments pursuant to 
42 C.F.R. § 493.1814). 


Please note that the routine survey takes an overview of the laboratory through random sampling. 
By its nature, the routine survey may not find every violation that the laboratory may have 
committed. It remains the responsibility of the laboratory and its director to ensure that the 
laboratory is at all times following all CLIA requirements, to identify any problems in the 
laboratory and take corrective action specific to the problems, and to institute appropriate quality 
assurance measures to ensure that the deficient practices do not recur. 


In addition to the routine CLIA certification surveys, announced or unannounced investigations/ 
surveys may be conducted by CMS or CMS’ agents at any time to address complaints or other 
non-compliance issues. These investigations/surveys may well identify violations that may not 
have surfaced during a routine survey using random sampling, but for which the laboratory and its 
director will still be held responsible. 


Instructions for Submitting the Laboratory’s Response 
All responses as well as any future correspondence pertaining to this survey should be sent to: 


Karen Fuller, Manager 

State Oversight and CLIA Branch 
Division of Survey and Certification 
Centers for Medicare & Medicaid Services 
90 7 Street, Suite 5-300 (5W) 

San Francisco, CA 94103-6707 


A copy of any response the laboratory makes to CMS’ San Francisco Regional Office must also 
be sent to CMS’ Central Office at the following address: 
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Division of Laboratory Services 

Survey and Certification Group (SCG) 

Center for Clinical Standards and Quality (CCSQ) 
Centers for Medicare & Medicaid Services 

7500 Security Blvd — Mail Stop C2-21-16 
Baltimore, MD 21244 

Attention: Sarah Bennett 


If you have questions regarding this letter, please contact Gary Yamamoto of my staff at (415) 


744-3738. 
Sincerely, 7 
Karen Fuller, Manager 


State Oversight and CLIA Branch 
Division of Survey and Certification 


Enclosure: Form CMS-2567, Statement of Deficiencies 
ce: California Department of Public Health, Laboratory Field Services 


CMS, Central Office 
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DEPARTMENT OF HEALTH AND HUMAN SERVICES FORM APPROVED 
CENTERS FOR MEDICARE & MEDICAID SERVICES | OMB NO, 0938-0391 


STATEMENT OF DEFICIENCIES (X1) PROVIDER/SUPPLIER/CLIA (X2) MULTIPLE CONSTRUCTION (X3) DATE SURVEY 
AND PLAN OF CORRECTION IDENTIFICATION NUMBER: A. BUILDING COMPLETED 


05D2025714 B. WING 11/20/2015 
NAME OF PROVIDER OR SUPPLIER STREET ADDRESS, CITY, STATE, ZIP CODE 


7333 GATEWAY BLVD 
THERANOS INC NEWARK, CA 94560 


(X4) ID SUMMARY STATEMENT OF DEFICIENCIES PROVIDER'S PLAN OF CORRECTION (X5) 
PREFIX | (EACH DEFICIENCY MUST BE PRECEDED BY FULL (EACH CORRECTIVE ACTION SHOULD BE COMPLETION 

TAG | REGULATORY OR LSC IDENTIFYING INFORMATION) CROSS-REFERENCED TO THE APPROPRIATE DATE 
DEFICIENCY) 


493.841(e) ROUTINE CHEMISTRY 


(1) For any unsatisfactory analyte or test 
performance or testing event for reasons other 
than a failure to participate, the laboratory must 
undertake appropriate training and employ the 
technical assistance necessary to correct 
problems associated with a proficiency testing | 
failure. | 
(2) For any unacceptable analyte or testing event 
score, remedial action must be taken and 
documented, and the documentation must be 
maintained by the laboratory for two years from 
the date of participation in the proficiency testing 
event. 

| This STANDARD is not met as evidenced by: 

| Based on review of proficiency testing (PT) 
documentation and interview with the General 
Supervisor (GS), the laboratory failed to 
investigate and document the investation of 
ungraded alkaline phosphatase (ALP) PT results 
| for the 3rd event of 2014. Findings include: 


'a. The laboratory was enrolled with the College 
of American Pathologists (CAP) PT program for 
ALP for the 3rd event 2014. 


b. The CAP results showed that five of five 
| samples (CHM-06 through CHM-10) were 
ungraded with a code [20]. 


c. There was no documenation that the 
ungraded ALP results had been investigated. 


d. The general supervisor stated that the Quality | 
Control/Quality Assurance (QC/QA) Manager was 
responsible for investigating ungraded PT results. 


e. The QC/QA Manger confirmed on 11/18/15 
that an investigation was not done or 
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documented. 
493.851(e) HEMATOLOGY 


(1) For any unsatisfactory analyte or test 
performance or testing event for reasons other 
than a failure to participate, the laboratory must 


undertake appropriate training and employ the 
| technical assistance necessary to correct 

| problems associated with a proficiency testing 
| failure. 


(2) For any unacceptable analyte or testing event 
score, remedial action must be taken and 
documented, and the documentation must be 
maintained by the laboratory for two years from 


| the date of participation in the proficiency testing 
| event. 
| This STANDARD is not met as evidenced by: 


Based on review of proficiency testing (PT) 
documentation and interview with the General 
Supervisor (GS), the laboratory failed to 
investigate and document the investigation of 
ungraded blood cell identification PT results and 
failed to investigate and document the 
investigation of an unsatisfactory blood cell 


| identification PT result for the 2nd event of 2014. 


Findings include: 


a. The laboratory was enrolled with the 
American Proficiency Institute (API) PT program 
for blood cell identification for the 2nd event 2014. 


b. The API results showed that two of five 
samples (BCI-13, BC/-14) were ungraded. 


c. The API results showed that BC!-11 was 
graded as “unacceptable.” 


d. There was no documenation that the 
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ungraded and unsatisfactory results had been 
i investigated. 


e. The general supervisor stated that the Quality 
Control/Quality Assurance (QC/QA) Manager was 
responsible for investigating ungraded PT results. 


f. The QC/QA Manger confirmed on 11/18/15 
that an investigation was not done or 
documented. 

493.1215 HEMATOLOGY 


If the laboratory provides services in the specialty 
of Hematology, the laboratory must meet the | 
requirements specified in §§493.1230 through 
493.1256, §493.1269, and §§493.1281 through 
493.1299. 


This CONDITION is not met as evidenced by: 
Based on the number and severity of the 
deficiencies cited herein, the Condition: 
Hematology was not met. The laboratory failed to 
have a procedure manual which included the 
corrective action to take when complete blood 
counts (CBC) calibration and quality control (QC) 
results failed to meet the laboratory's criteria for 
acceptability (see D5403); document CBC 
calibrations (see D5437); include two QC 
materiais with differing white blood cell (WBC) 
patterns each day of testing (see D5447): verify 
stated values of commercially assayed CBC 
controls (see D5469): ensure QC for PT/INR was 
acceptable prior to reporting patient test results 
(see D5481): follow corrective action policies and 
procedures as necessary to maintain the 
jaboratory operation for testing patient CBC 
specimens in a manner that ensured accurate 
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and reliable patient test results and reports (see 
D5779); have an analytic systems quality 


assessment mechanism that included a review of 


the effectiveness of the laboratory's CBC 
processes and flow cytometer corrective actions 
taken to resolve problems (see D5779); and 
ensure that the calculated International 
Normalized Ratio (INR) results were accurate 
prior to reporting final patient results (see D5801). 
493.1236(c)(1) EVALUATION OF PROFICIENCY 
TESTING PERFORMANCE 


At least twice annually, the laboratory must verify 
the accuracy of any test or procedure it performs 
that is not included in subpart | of this part. 

This STANDARD is not met as evidenced by: 
Based on review of proficiency testing records 
and interview with the General Supervisor, the 
laboratory failed to investigate and document an 
investigation of ungraded troponin proficiency 
testing (PT) results from the 2nd event 2014. 
Findings include: 


a. The laboratory was enrolled in proficiency 
testing for troponin with the American Proficiency 
Institute (API) for the 2nd event 2014. 


b. Troponin results for five of five specimens 
(CM-06 through CM-10) were ungraded by API. 


c. There was no documentation that the 
ungraded results had been investigared or 
reviewed by the laboratory personnel. 


d. The general supervisor stated that the Quality 
Control/Quality Assurance (QC/QA) Manager was 
responsible for investigating ungraded PT results. 
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e. The QC/QA Manger confirmed on 11/18/15 
that an investigation was not done or 
documented. 

493.1242(a) SPECIMEN SUBMISSION, 
HANDLING, AND REFERRAL 


The laboratory must establish and follow written 
policies and procedures for each of the following, | 
if applicable: 

(1) Patient preparation. 

(2) Specimen collection. 

(3) Specimen labeling, including patient name or 
unique patient identifier and, when appropriate, 
specimen source. 

(4) Specimen storage and preservation. 

(5) Conditions for specimen transportation. 

(6) Specimen processing. 

(7) Specimen acceptability and rejection. 

(8) Specimen referral. 

This STANDARD is not met as evidenced by: 
Based on laboratory personnel interviews and 
pre-analytic policies and procedures record 
review on September 23, 2015, the laboratory 
failed to establish written policies and procedures 
for patient specimen labeling. Findings included: 


a. it was the practice of the laboratory to require 
that all patient specimens received be labeled 
with laboratory generated bar codes that were 
issued at the point of specimen collection. 


b. The laboratory maintained no written policies 
and procedures detailing this patient specimen 
| labeling policy and procedure. 


| c. According to laboratory records, the 
| laboratory performed approximately 890,000 
patient tests annually. 
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493.1249(a) PREANALYTIC SYSTEMS QUALITY 
ASSESSMENT 


The laboratory must establish and follow written 
policies and procedures for an ongoing 


i mechanism to monitor, assess, and when 


indicated, correct problems identified in the 
preanalytic systems specified at §§493.1241 
through 493.1242. 


This STANDARD is not met as evidenced by: 


{. Based on laboratory personnel interviews and 
pre-analytic remedial action record review on 
September 23, 2015, the laboratory failed to 
establish written policies and procedures for an 
ongoing mechanism to monitor, assess, and 
when indicated, correct problems identified in the 
laboratory's preanalytic systems when received 
patient specimens did not meet the laboratory's 
criteria for acceptability. Findings included: 


a. According to laboratory personnel, during the 
accessioning of patient specimens, if a patient 
specimen was received that did not meet the 
laboratory's criteria for acceptability, a description 
as to why the specimen did not meet the 
laboratory's criteria for acceptability would be 
electronically noted, applicable laboratory 
personnel would be notified, appropriate 
corrective actions would be taken and 
electronically noted, and the incident would be 
captured for quality assessment review. 


b. The laboratory maintained no written policies 
and procedures detailing this quality assessment 
process. 


c. According to laboratory records, the 
laboratory performed approximately 890,000 
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patient tests annually. 


2. Based on laboratory personnel interviews and 
patient specimen referral policies and procedures 
record review on September 23, 2015, the 
laboratory failed to establish written policies and 
procedures for an ongoing mechanism to 
monitor, assess, and when indicated, correct 
problems identified in the laboratory's preanalytic 
systems for patient specimens referred to other 
laboratories for testing. Findings included: 


a. According to laboratory personnel, a log of 
patient specimens referred to other laboratories 
for testing was reviewed daily to ensure the timely 
receipt and reporting of the test results performed 
by the other laboratories. 


b. The laboratory maintained no written policies 
and procedures detailing this quality assessment 
process. 
493.1249(b)(c) PREANALYTIC SYSTEMS D5393 | 
QUALITY ASSESSMENT | 
The preanalytic systems assessment must | 
include a review of the effectiveness of corrective 
actions taken to resolve problems, revision of | 
policies and procedures necessary to prevent 
recurrence of problems, and discussion of 
preanalytic systems quality assessment reviews 
with appropriate staff. The laboratory must 
document ail preanalytic systems quality 
assessment activities. 


| This STANDARD is not met as evidenced by: 

| Based on laboratory personnel interviews and 

| patient specimen referral policies and procedures 
| record review on September 23, 2015, the 
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laboratory failed to document all preanalytic 
systems quality assessment activities, specifically 
for patient specimens referred to other 
laboratories for testing. Findings included: 


a. According to laboratory personnel, a log of 
patient specirnens referred to other laboratories 
for testing was reviewed daily to ensure the timely 
receipt and reporting of the test results performed 
by the other laboratories. 


b. The laboratory maintained no documentation 
indicating that the patient specimen referral log 
was reviewed daily. 

493.1250 ANALYTIC SYSTEMS 


Each laboratory that performs nonwaived testing 
must meet the applicable analytic systems 
requirements in §§493.1251 through 493.1283, 
unless HHS approves a procedure, specified in 
Appendix C of the State Operations Manual (CMS 
Pub.7), that provides equivalent quality testing. 
The laboratory must monitor and evaluate the 
overall quality of the analytic systems and correct 
identified problems as specified in §493.1289 for 
each specialty and subspecialty of testing 
performed. 


This CONDITION is not met as evidenced by: 
Based on the number and severity of the 
deficiencies cited herein, the Condition: Analytic 
Systems was not met. The laboratory failed to 
have a procedure manual that included corrective 
action for chernistry quality contro] (QC) (see 
D5403); failed to have procedures signed, dated, 
and approved by the laboratory director prior to 
use (see D5407); failed to have freezer 
temperature consistent with manufacturer 
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requirements (see D5413); failed to verify 
performance specifications on the Advia XPT 
(see D5421); failed to establish performance 
specification when the alkaline phosphatase test 
system was modified (see D5423): failed to 
perform weekly maintenance on the Evolis (see 
D5429): failed to document hematology 
calibration (see D5437); failed to include two 
quality control materials at least once each day 
WBC differentials were performed (see D5447); 
failed to include positive quality contro] materials 
each day patient specimens were assayed (see 
D5449): failed to verify the criteria for 
acceptability of quality control materials for 
hematology and chemistry (see D5469): failed to 
check blood agar plates for its ability to support 


results met the laboratory's criteria for 
acceptability for Prothrombin Time/international 
Normalized Ratio and the Theranos Proprietary 
System (TPS) prior to reporting patient test 
results (see D5481): failed to have a system that 
| twice per year evaluated and defined the 

| relationship for WBC differentials and the TPS 

| (see D5775); failed to follow hematology 

| corrective action policies and procedures (see 
D5779); failed to have a record system that 


patient bacteriology specimens (see D5787); 
failed to follow quality assessment (QA) policies 
and procedures (see D5791); and failed to 
monitor the effectiveness of corrective actions 
and revise policies and procedures to prevent 
recurrence of problems (see D5793). 
493.1251(b) PROCEDURE MANUAL 
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(1) Requirements for patient preparation; 
specimen collection, labeling, storage, 
preservation, transportation, processing, and 
referral, and criteria for specimen acceptability 
and rejection as described in §493.1242. 

(2) Microscopic examination, including the 
detection of inadequately prepared slides. 

(3) Step-by-step performance of the procedure, 
including test calculations and interpretation of 
results. 

(4) Preparation of slides, solutions, calibrators, 
controls, reagents, stains, and other materials 
used in testing. 

(5) Calibration and calibration verification 
procedures. 

(6) The reportable range for test results for the 
test system as established or verified in 
§493.1253. 

(7) Control procedures. 

(8) Corrective action to take when calibration or 
control results fail to meet the laboratory's criteria 
for acceptability. 

(9) Limitations in the test methodology, including 
interfering substances. 

(10) Reference intervals (normal values). 

(11) imminently life-threatening test results, or 
panic or alert values. 

(12) Pertinent literature references. 

(13) The laboratory's system for entering results 
in the patient record and reporting patient results 
including, when appropriate, the protocol for 
reporting imminently life threatening results, or 
panic, or alert values. 

(14) Description of the course of action to take if a 
test system becomes inoperable. 


This STANDARD is not met as evidenced by: 
1. Based on laboratory personnel interviews and 
the laboratory's hematology Advia 2120) 
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procedure record review on November 19, 2015, | 
the laboratory failed to have a procedure manual | 
that Included the corrective action totake when 
calibration or quality control results failed to meet 
the laboratory's criteria for acceptability. Findings 
included: 


a. It was the practice of the laboratory to test 
patient venous complete blood counts (CBC) 
specimens using a Siemens Advia 2120i 
instrument. 


b. In the laboratory's procedure titled "SOP 
Advia 2120] Operation and Maintenance," there 
was no written protocol for the corrective action to 
be taken when calibration or quality control 
results failed to meet the laboratory's criteria for 
acceptability. 


c. Between February 2015 and September 21, 
2015, the laboratory performed and reported 
2,395 patient CBC test results using the Advia 

| 2120i. 


|2. Based on review of the quality control (QC) 
procedure for the Edison 3.5 Theranos System 
and documentation provided by the laboratory, 
the laboratory failed to have a procedure for QC 
prior to 5/15/2014. Findings include: 


a, CL SOP-15026 Revision A, "Edison 3.5 
Theranos System Daily QC Procedure” revealed 
an effective date of 5/15/2014. 


b. Achart provided by the laboratory indicated 
that eight of twelve analytes run on the above 
system were put into use for patient testing prior 
to 5/15/2014. The initial use dates of the eight 
analytes ranged from 11/6/2013 through 
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5/9/2014. 
493.1251(d) PROCEDURE MANUAL 


Procedures and changes in procedures must be 
approved, signed, and dated by the current 
laboratory director before use. 

This STANDARD is not met as evidenced by: 
Based on review of procedures and interview 
with the technical supervisor, the current 
laboratory director (LD) failed to sign, date and 
approve procedures prior to use. Findings 
include: 


a. The current LD start date was 2/10/2015. 


b. Eight procedures were reviewed. Seven of 
seven procedures did not include a LD signature 
prior to putting into use and one of one was not 
signed by the current LD. 


c. CL SOP-09161, Revision A (Apolipoprotein) 
showed an effective date of 12/5/2014, but was 
not signed by the LD until 9/19/2015. it was 
signed by a technical supervisors "for the LD." 
The procedure was not signed, dated and 
approved by any LD prior to 9/19/2015. 


d. CL SOP-10001, Revision B (Measuring 
Prothrombin Time-innovin (PT) on the Siemens 
BCS XP Instrument) showed an effective date of 
12/5/2014, but was not signed by the LD until 
9/19/2015. The procedure was not signed, dated 
and approved by any LD prior to 9/19/2015. 


e. CLSOP-06060, Revision A (SensoScientific 
Monitor) showed an effective date of 6/23/2015, 
but was not signed by the LD until 9/22/2015. 
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D5407 | Continued From page 12 
if. CL SOP-15036, Revision A (Edison 3.5 
| Theranos System Daily QC Procedure) showed 
| an effective date of 12/5/2014, but was not signed | 
by the LD until 9/19/2015. The procedure was 
not signed, dated and approved by any LD prior 
to 9/19/2015. 


g. CL PLN-14003, Revision A (Master Validation 
Chemistry Assays on Theranos Devices) showed 
an effective date of 11/4/2011, but was not signed 
by the LD until 9/19/2015. The procedure was 
not signed, dated and approved by any LD prior 
to 9/19/2015. 


h. Three of three procedures for the Advia 
Chemistry System (Glucose/CL SOP-09118, 
Carbon Dioxide (CO2)/CL SOP-09111, Alkaline 
Phosphatase/CL SOP-81102) were put into use in 
December 2014. The CO2 and alkaline 
phosphatase procedures were not signed, dated 
and approved by the LD until 9/19/2015. The 
glucose procedure was not signed, dated and 
approved by the LD. 

493.1252(b) TEST SYSTEMS, EQUIPMENT, 
INSTRUMENTS, REAGENT 


The laboratory must define criteria for those 
conditions that are essential for proper storage of 
reagents and specimens, accurate and reliable 
test system operation, and test result reporting. 
The criteria must be consistent with the 
manufacturer's instructions, if provided. These 
conditions must be monitored and documented 
and, if applicable, include the following: 

(1) Water quality. 

(2) Temperature. 

(3} Humidity. 

(4) Protection of equipment and instruments from 
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fluctuations and interruptions in electrical current 
that adversely affect patient test results and test 
reports. 

This STANDARD is not met as evidenced by: 

1. Based on observation and document review, 


ranges that were consistent with the 
manufacturer's instructions for freezers which 
stored reference maierials and patient 
specimens. Findings include: 


a. A tour of the laboratory where the freezers 


were kept showed that the freezer doors were 
labeled with the laboratory's acceptable 
temperature ranges. 


a temperature range of -60 to -90 C. 


c. Six of six -20 C freezers were marked with a 
temperature range of -17 to -25 C. 


d. Review of two manufacturer instructions for 
samples stored in the -80 freezers required that 
the samples be kept at "at least -80 C." 


e. Review of 3 manufacturer instructions for 
samples stored in the -20 freezers required that 
the samples be kept at “at least -20 C." 


f. The Director of Assay Systems and technical 
supervisor confirmed at 11/19/15 at 
approximately 11 am that the freezers were 
labeled with the above ranges and that the 
ranges did not meet the manufacturers 
instructions. 


2. Based on review of the procedure, 
manufacturer package insert (PI) and 
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{ 


_ observation, the laboratory failed to follow the 

| manufacturer instructions for expiration date of 
_ Innovin (thromboplastin) used for Prothrombin 
| Time/International Normalized Ratio (PT/INR) 

| testing. Findings include: 


| a. Dade Innovin (thromboplastin) lot number 
539280 was put into use by the laboratory at the 


end of March 2015. 


b. The general supervisor stated that the 
package inserts were usuaily white. 


c. The package insert for lot number 539280 
was pink which indicated that the manufacturer 
had included special instructions for the specific 
lot number of Innovin. 


d. Review of the Pl revealed an "important note" | 
that this specific lot number was only stable for 2 | 
days instead of 10 days after reconstitution when | 
stored at 2-8 C. 


e. The current vial of Innovin reagent was 
observed in the 2-8 C refrigerator with a 5 day 
expiration cate. 


f. CL SOP-10001 Revision A, “Measuring 
Prothrombin Time..." stated on page 10, section 
12.1 that "the package insert for a new lot must 
be reviewed for any changes before use." 


g. The general supervisor confirmed on 9/23/15 
that the change in storage and stability of the 
Innovin reagent had not been identified from 
March 2015 through September 2015. 
493.1253(b}(1) ESTABLISHMENT AND 
VERIFICATION OF PERFORMANCE 
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Each laboratory that introduces an unmodified, 
FDA-cleared or approved test systern must do the 
following before reporting patient test results: 
(1)(i) Demonstrate that it can obtain performance 
specifications comparable to those established by 
the manufacturer for the following performance 
characteristics: 

(1)()(A) Accuracy. 

i (1)()(B) Precision. 

_ (1)()(C) Reportable range of test results for the 

_ test system. 

(1) (ii) Verify that the manufacturer's reference 

_ intervals (normal values) are appropriate for the 

| laboratory's patient population. 

| This STANDARD is not met as evidenced by: 

| {. Based on review of the performance 

| specification verification documentation and 


| interview with the general supervisor and 

| technical supervisor, the laboratory failed to 
maintain any documentation that the laboratory 
had participated in conducting the verification of 
the performance specifications on the Advia XPT. 
Findings include: 


a. The general supervisor and techincal 
supervisor stated that the manufacturer 
performed all of the performance specification 
verification activities on the Advia XPT. 


b. They further stated that the laboratory staff 
were available to prepare quality control material 
and gathering patient samples for the 
manufacturer representative to perform the 
verification. 


c. The Director of Assays confirmed that the 
manufacturer had performed the verification of 
performance specifications on the Advia XPT. 
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2. Based on review of verification procedures, 
verification documentation and interivew with 
general supervisor and technical supervisor, the 
laboratory failed to verify accuracy, precision, 
and/or reportable range for calcium, albumin, 
apolipoprotein, triglyceride, carbon dioxide, and 
glucose. In addition, the laboratory failed to verify 
the reference interval (normal range) for carbon 
dioxide. Findings include: 


a. CL QOP-00022, "Verification of Procedures 
Revision A’, effective 8/12/14, stated in Section 
V.B.1.a. in order to determine accuracy "at least 
20 samples of various reactivity's should be 
compared between the method and the old 
method...ifa second method is not available 
onsite, compare 20 samples tested by a different 
method used by a different laboratory.” The 
procdures also stated that the validation plan 
should determine what percentage of accuracy is 
acceptable. 


b. CL QOP-00022, "Verification of Procedures 
Revision A", effective 8/12/14, stated in Section 
V.B.1.b. that “a replication experiment” is used to 
determine precision. The procedure further 
stated that “at least 20 samples of various 
reactivity's are run 2 or 3 times and results 
compared. Duplicate runs may be on different 
days or by different microbiologists..." The 
procedure also required that the percentage of 
precision for acceptability must be determined. 


ic. CL QOP-00022, "Verification of Procedures 
Revision A’, effective 8/12/14, stated in Section 
V.B.1.c. that the reportable range “is the range of 
test results from the lowest to the highest that are 
reliable and therefore reportable." 
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d. CL QOP-00022, "Verification of Procedures 
Revision A," effective 8/12/14, stated in Section 
V.B.1.d. required that the validation plan be 
approved by the laboratory director “before 
testing begins.” 


e. The general supervisor and techincal 
supervisor stated that the Advia XPT was put into 
use 12/18/14. 


Calcium 


i. Standard Operating Procedure (SOP) CL 
SOP-09107, "Calcium (CA, CA_2} in serum, 
plasma or urine on the Siemens Advia Chemistry 
Systems indicated that the reportable range for 
serum and plasma samples was 1.0-16.0 mg/dL. 


ii, The manufacturer performed the verification 
of performance specifications for serum on 
10/23/14. There was no documentation that the 
performance specifications had been verified for 
plasma samples. 


iii. The accuracy study included samples which 
ranged from 4.58-15.8 mg/dL. 


iv. The accuracy study did not include samples 
across the entire reportable range. 


v. The accuracy study did not include a 
comparison study as required by the laboratory's 
procedure. 


vi. The accuracy study did not indicate an 
acceptable percentage for accuracy. 


vil. The precision study included samples which 
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ranged from 4.58-12.93 mg/dL. 


vill, The precision study did not include samples 
across the entire reportable range. 


ix. The precision study only included within run 
precision and did not include day-to-day, 
run-to-run, or different operators. 


x. The summary report from the manufacturer 
showed that the reportable range for serum 
calcium was 0.5-16.0 mg/dL which differed from 
the calcium SOP. 


xi. The reportable range data showed included 
sampies from 1.0-13.4 mg/dL which did not cover 
the entire reportable range stated in the SOP. 


| Albumin 


i. Standard Operating Procedure (SOP) CL 

| SOP-09186 Revision A, "Aloumin BCP (ALP) in 

| serum or plasma Advia Chemistry Systems 
indicated that the reportable range for serum and 
plasma samples was 0.6-8.0 g/dL. The SOP was 
| effective 7/31/15. 


| ii. The manufacturer performed the verification 
of performance specifications for serum on 

| 10/23/14. There was no documentation that the 
| performance specifications had been verified for 
i plasma samples. 


ili. The accuracy study included samples which 
| ranged from 2,0-4.4 g/dL. 


iv. The accuracy study did not include samples 
across the entire reportable range. 
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v. The accuracy study did not include a 
comparison study as required by the laboratory's 
| procedure. 


vi. The accuracy study did not indicate an 
acceptable percentage for accuracy. 


vil. The precision study included samples which 
ranged from 0.5-5.5 g/dL. 


vill, The precision study did not include samples 
across the entire reportable range. 


ix. The SOP stated that for precision each 
sample 2 times per run, 2 runs per day, for at 
least 20 days. 


x. The precision study only included within run 
precision and did not include 2 times per run, 2 
runs per day, for at least 20 days. 


xi. The summary report from the manufacturer 
showed that the reportable range for serum 


SOP. 


xi. The reportable range data showed included 
samples from 0.4-6.9 g/dL which did not cover 
the entire reportable range stated in the SOP. 


Apolipoprotein 


i. Standard Operating Procedure (SOP) CL 
SOP-09161 Revision A, “Apolipoprotein A-1 in 
serum or plasma Chemistry Systems indicated 
that the reportable range for serum and plasma 
samples was 15-(200-260) mg/dL. The SOP 
stated that the reference interval (normal range) 
for males was 79-169 mg/dL and females was 76 
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-214 ma/dL. 


ii, The manufacturer performed the verification 
| of performance specifications for serum on 

| 11/6/14. There was no documentation that the 
performance specifications had been verified for 
plasma samples. 


‘ili. The accuracy study included samples which 
ranged from 88.6-412.0mg/dL. 


iv. The accuracy study did not include samples 
across the entire reportable range. 


v. The accuracy study did not include a 
comparison study as required by the laboratory's | 
procedure. / 


vi. The accuracy study did not indicate an 
acceptable percentage for accuracy. 


vil. The precision study included samples which 
ranged from 100.9-314.7 mg/dL. 


vill. The precision study did not include samples 
across the entire reportable range. 


| ix. The precision study only included within run 
| precision and dic not include day-to-day, 
run-to-run, or different operators. 


|x. The summary report from the manufacturer 
| showed that the reportable range for serum was 
"45- “mg/dL which differed from the SOP. 


| Triglyceride 


i. The manufacturer performed the verification 
of performance specifications on 10/23/14. The 


FORM CMS-2567(02-99) Previous Versions Obsolete Event ID: W34211 Facility ID: CA22046272 If continuation sheet Page 21 of 121 


FOIA Confidential Treatment Requested by Theranos TS-0917907 
Trial Exh. 4621 Page 0025 ER-5482 


Case: 22-10338, 05/04/2023, ID: 12709436, DktEntry: 22-21, Page 89 of 188 


PRINTED: 01/25/2016 
DEPARTMENT OF HEALTH AND HUMAN SERVICES FORM APPROVED 


CENTERS FOR MEDICARE & MEDICAID SERVICES OMB NO, 0938-0391 


STATEMENT OF DEFICIENCIES (X1) PROVIDER/SUPPLIER/CLIA (X2) MULTIPLE CONSTRUCTION (X3) DATE SURVEY 
AND PLAN OF CORRECTION IDENTIFICATION NUMBER: A. BUILDING COMPLETED 


05D2025714 B. WING 41/20/2015 
NAME OF PROVIDER OR SUPPLIER STREET ADDRESS, CITY, STATE, ZIP CODE 
7333 GATEWAY BLVD 
NEWARK, CA 94560 


SUMMARY STATEMENT OF DEFICIENCIES | PROVIDER'S PLAN OF CORRECTION (x5) 
(EACH DEFICIENCY MUST BE PRECEDED BY FULL (EACH CORRECTIVE ACTION SHOULD BE | COMPLETION 

REGULATORY OR LSC IDENTIFYING INFORMATION) CROSS-REFERENCED TO THEAPPROPRIATE | DATE 
DEFICIENCY) 


THERANOS INC 


Continued From page 21 


manufacturer summary report showed that the 
reportable range was 0-500 mg/dL. The 

| manufacturer summary report revealed reference 
interval (normal range) was 0-300 mg/dL. 


‘ii, The accuracy study included samples which 
| ranged from 62.7-259 mg/dL. 


| iii. The accuracy study did not include samples 
| across the entire reportable range. 


| iv. The acuracy study did not include a 
comparison study as required by the laboratory's | 
procedure. 


v. The accuracy study did not indicate an 
acceptable percentage for accuracy. 


vi. The precision study included samples which 
ranged from 77.6-237.3 mg/dL. 


vil. The precision study did not include samples 
across the entire reportable range. 


vill, The precision study only included within run 
precision and did not include day-to-day, 
run-to-run, or different operators. 


ix. The reportable range data included samples 
from 74.0-447.0 mg/dL which did not cover the 
entire reportable range stated in the SOP. 


x. The laboratory director did not sign and 
approve the verification of performance 
| specifications. Patient testing began 12/18/14. 


| Glucose 


,i. Standard Operating Procedure (SOP) CL | 
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SOP-09118 Revision A, "Glucose in serum, 
plasma, urine or CSF on the Advia Chemistry 
Systems" indicated that the reportable range for 
serum and plasma samples was 4-700 mg/dL. 


ii, The manufacturer performed the verification 
of performance specifications for serum on 
10/23/14. There was no documentation that the 
performance specifications had been verified for 
plasma samples. 


iii. The accuracy study included samples which 
ranged from 47.2-384.0 mg/dL. 


iv. The accuracy stucy did not include samples 
across the entire reportable range. 


v. The accuracy study did not include a 
comparison study as required by the laboratory's 
procedure. 


vi. The accuracy study did not indicate an 
acceptable percentage for accuracy. 


vil. The precision study included sarnmples which 
ranged from 57.9-356.2 mg/dL. 


vill. The precision study did not include samples 
across the entire reportable range. 


ix. The precision study only included within run 
precision and did not include 2 times per run, 2 
runs per day, for at least 20 days. 


x. The reportable range data showed included 
sampies from 10.6-557.27 mg/dLwhich did not 
cover the entire reportable range stated in the 
SOP. 
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Carbon Dioxide (CO2) 


i. Standard Operating Procedure (SOP) CL 
| SOP-09111 Revision B, "CO2 in serum or plasma 
| on the Advia Chemistry Systems" indicated that 


40 mEd/L. . 


' ii. The manufacturer performed the verification 
| of performance specifications for serum on 
10/23/14. There was no documentation that the 
| performance specifications had been verified for 
plasma samples. 


| iii, The accuracy study included samples which 
ranged from 12.9-34.3 mEq/L. 


iv. The accuracy study did not include samples 
| across the entire reportable range. 


v. The accuracy study did not include a 
| procedure. 


ivi. The accuracy study did not indicate an 
acceptable percentage for accuracy. 


| vii. The precision study included samples which 
ranged from 14.3-23.0 mEq/L. 


vill. The precision study did not include samples 
across the entire reportable range. 


ix. The precision study only included within run 
precision and did not include 2 times per run, 2 
runs per day, for at least 20 days. 


x. The manufacturer summary report indicated 
that the verification of the reference interval did 


the reportable range for serum or plasma was 10- 


| comparison study as required by the laboratory's | 
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| not pass. 


xi. No further documentation verifying the 
| reference interval was presented to the surveyor. 


xii. The laboratory director approved the 

| verification study on 11/18/14. Patient testing 
| began on 12/18/14. 

493.1253(b)(2) ESTABLISHMENT AND 

| VERIFICATION OF PERFORMANCE 


Each laboratory that modifies an FDA-cleared or 
approved test system, or introduces a test system | 
| not subject to FDA clearance or approval 
(including methods developed in-house and 
standardized methods such as text book 
procedures), or uses a test system in which 
performance specifications are not provided by 
the manufacturer must, before reporting patient 
test results, establish for each test system the | 
performance specifications for the following 
performance characteristics, as applicable: 

(2)(i) Accuracy. 

(2) (il) Precision. 

(2\(iii) Analytical sensitivity. 

(2)(iv) Analytical specificity to include interfering 
substances. 

(2)(v) Reportable range of test results for the test 
system. 

(2)(vi) Reference intervals (normal values). 
(2)(vii) Any other performance characteristic 
required for test performance. 

This STANDARD is not met as evidenced by: 
Based on review of the alkaline phosphatase 

i procedure, manufacturer verification report and 
interview with the Director of Assays, the 
laboratory failed to establish performance 

| Specifications when the laboratory modified the 
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reportable range for alkaline phosphatase. 
Findings include: 


a. Standard Operating Procedure (SOP) CL 
SOP-09102 Revision B, “Alkaline Phosphatase 


Systems" indicated that the reportable range for 
serum and plasma samples was 0-1100 IU/L. 


b. The Director of Assays stated that the 
reportable range was 10-1100 IU/L and that the 
SOP was incorrect. 


c. The manufacturer performed the verification 
of performance specifications for serum on 
10/23/14. There was no documentation that the 
performance specifications had been verified for 
plasma samples. 


d. The accuracy study included samples which 
ranged from 23.70-423.0 IU/L. 


e. The accuracy study did not include samples 
| across the entire reportable range. 


f. The accuracy study did not include a 
| comparison study as required by the laboratory's 
| procedure. 


|g. The accuracy study did not indicate an 
| acceptable percentage for accuracy. 


h. The precision study included samples which 
ranged from 30.9-359.0 IU/L. 


i. The precision study did not include samples 
across the entire reportable range. 


j. The precision study included within run 
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precision, but did not include day-to-day, 
| fun-to-run, or different operators. 


k. The summary report from the manufacturer 
showed that the reportable range for serum ALP 
| was 0-1100 IU/L. 


|. The reportable range data showed included _ 
samples from 12-914 IU/L which did not cover the 

entire reportable range. 
| 


|m. The Director of Assays stated that analytic 
sensitivity and analytic specifictity was not 
established for the modified ALP assay. 
493.1254(a)(1) MAINTENANCE AND FUNCTION 

i CHECKS 


For unmodified manufacturer's equipment, 
instruments, or test systems, the laboratory must 
| perform and document maintenance as defined 

, by the manufacturer and with at least the 
frequency specified by the manufacturer. 

This STANDARD is not met as evidenced by: 
Based on technical supervisor interviews and 

| Evolis maintenance log record review on 
November 17, 2015, the laboratory failed to 
perform weekly Evolis maintenance as defined by 
the manufacturer. Findings included: 


a. In general immunology, it was the practice of | 
the laboratory to test patient ANA, HIV Ag/Ab, and 
quantiferon using the Bio-Rad Evolis system. 


b. In August 2015, for 2 (weeks 1 and 3) of 4 
weeks in which patient specimens were tested, 
the laboratory maintained no documentation to 
indicate that weekly manufacturer required 
maintenance had been performed. 


FORM CMS-2567 (02-99) Previous Versions Obsolete Event 1D: W34211 Facility ID: CA22046272 If continuation sheet Page 27 of 121 


FOIA Confidential Treatment Requested by Theranos TS-0917913 
Trial Exh. 4621 Page 0031 ER-5488 


Case: 22-10338, 05/04/2023, ID: 


DEPARTMENT OF HEALTH AND HUMAN SERVICES 
CENTERS FOR MEDICARE & MEDICAID SERVICES 


STATEMENT OF DEFICIENCIES 
AND PLAN OF CORRECTION 


(X41) PROVIDER/SUPPLIER/CLIA 
IDENTIFICATION NUMBER: 


05D2025714 


NAME OF PROVIDER OR SUPPLIER 


THERANOS INC 


(X4) ID 
PREFIX 
TAG 


FORM CMS-2567(02-99) Previous Versions Obsolete 


_ Continued From page 27 


| reported 844 patient HIV Ag/Ab test results using 
' the Evolis system. 


| each applicable test system the laboratory must 


_ instrument calibrations performed using the Drew 


|a. [twas the practice of the laboratory to test 


SUMMARY STATEMENT OF DEFICIENCIES 
(EACH DEFICIENCY MUST BE PRECEDED BY FULL 
REGULATORY OR LSC IDENTIFYING INFORMATION) 


c. In August 2015, the laboratory performed and 


493.1255(a) CALIBRATION AND CALIBRATION 
VERIFICATION 


Unless otherwise specified in this subpart, for 


perform and document calibration procedures-- 
(1) Following the manufacturer's test system 
instructions, using calibration materials provided | 
or specified, and with at least the frequency 
recommended by the manufacturer; 

(2) Using the criteria verified or established by the 
laboratory as specified in §493.1253(b)(3)-- 
(2)(i) Using calibration materials appropriate for | 
the test system and, if possible, traceable toa 
reference method or reference material of known 
value; and 
(2)(ii) Including the number, type, and 
concentration of calibration materials, as well as 
acceptable limits for and the frequency of 
calibration; and 

(3) Whenever calibration verification fails to meet | 
the laboratory's acceptable limits for calibration 
verification. 


This STANDARD is not met as evidenced by: 

1. Based on laboratory personnel interviews and 
complete blood counts (CBC) calibration 
documentation record reviews on September 23, 
2015, the laboratory failed to document all CBC 


3 instruments. Findings included: 
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patient capillary CBC specimens using two Drew 
3 instruments the laboratory designated as "Drew 
#2" and “Drew #3." On September 23, 2015, 
information recorded on "Drew #2" indicated that 
the "Drew #2" was calibrated on August 24, 2015, 
and information recorded on "Drew #3" indicated 
that the "Drew #3" was calibrated on August 31, 
12015, 


b. The laboratory maintained no documentation 
| of the August 24, 2015 and August 31, 2015 
calibrations of the laboratory's two Drew 3 CBC 
instruments. 


c. According to laboratory personnel, between 
| August 24, 2015 and September 23, 2015, the 
laboratory performed and reported 864 patient 
CBC specimens using the two Drew 3 

| instruments. 


|2. Based on laboratory personnel interviews and 
| complete blood counts (CBC) calibration 
documentation record reviews on November 19, 

| 2015, the laboratory failed to document all CBC 
instrument calibrations performed using a Advia 

| 2120) instrument. Findings included: 


| a. It was the practice of the laboratory to test 

| patient venous CBC specimens using two 
Siemens Advia 2120i instruments, designated as 
#1 and #2. 


b. For Advia 2120i #1, the laboratory maintained 
_ no documentation of any calibrations prior to 
September 21, 2015. For Advia 21201 #2, the 

' laboratory maintained no documentation of any 

| calibrations performed. 


'c. Between February 2015 and September 21, 
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2075, the laboratory performed and reported 
2,395 patient CBC test results using the Advia 
| 21201 #1. From November 6, 2015 to November 
19, 2015, the laboratory performed and reported | 
67 patient CBC test results using the Advia 21201 | 
#2, 
493.1256(d)}(3)(i)(g) CONTROL PROCEDURES 


Uniess CMS Approves a procedure, specified in 
Appendix C of the State Operations Manual 
(CMS Pub. 7), that provides equivalent quality 
testing, the laboratory must-- 


At least once a day patient specimens are 
assayed or examined perform the following for-- 


Each quantitative procedure, include two control 
materials of different concentrations; 


(g) The laboratory must document all control 
procedures performed. 
This STANDARD is not met as evidenced by: 
Based on laboratory personnel interviews and 
WBC differential quality control record review on 
November 19, 2015, the laboratory failed to 
include two quality control materials with differing 
WBC differential patterns at least once each day 
; patient WBC differential specimens were 
examined using the Cellavision instrument. 
| Findings included: 


a. It was the practice of the laboratory to use the 

| Cellavision instrument to aid in the examination 

| and reporting of patient WBC differentials 
performed from stained slides. 


b. According to laboratory personnel, although 
the laboratory performed a function check (cell 
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locator) each day the Cellavision was used to 
examine patient stained slides, the laboratory did | 
not examine two quality contro! materials with 
differing WBC differential patterns each day the 
Cellavision was used to examine patient stained 
slides. Laboratory personnel also stated that all 
Cellavision examinations were reviewed by 
testing personnel and revised, if necessary, 
before the examination was release for reporting. 
However, the Cellavision did perform the primary 
WEC differential screening of patient stained 
slides. 


c. According to laboratory personnel, since 
February 2015, the laboratory examined and 
reported 225 patient WBC differentials using the 
Cellavision, 

493.1256(d)(3)(iI)(g) CONTROL PROCEDURES 


Unless CMS Approves a procedure, specified in 
Appendix C of the State Operations Manual 

i (CMS Pub. 7), that provides equivalent quality 

| testing, the laboratory must-- 


| At least once a day patient specimens are 
assayed or examined perform the following for-- 


Each qualitative procedure, include a negative 
and positive control material; 


(g) The laboratory must document all control 
procedures performed. 

This STANDARD is not met as evidenced by: 
Based on technical supervisor interview and 
CT/NG quality control record review on 
Novernber 17, 2015, at least once a day patient 
specimens were assayed, the laboratory failed to 
include a positive CT/NG quality control material. 
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Findings included: 


a. It was the practice of the laboratory to 
perform and report patient CT/NG testing using a 
PCR method. 


b. Laboratory records indicated that on 
November 13, 2075 the laboratory performed 
patient CT/NG testing without including a positive 
CT/NG quality control material in the assay. 
Although the laboratory included samples the 
manufacturer labeled as a "positive" CT/NG 
quality control material in the assay, the test 
results of this “positive” CT/NG quality control 
material were used to calculate the assay cutoff 
which determines whether patient test results 
tested as positive or negative for CT/NG. As a 
result, the manufacturer's "positive" CT/NG 
quality control material was considered a 
calibrator and not quality control material. The 
laboratory assayed no other positive CT/NG 
quality control materials. 


c. On November 13, 2015, the laboratory tested 
41 patient CT/NG specimens. 


d. Pursuant to 42 C.F.R. 493.1256(d)(9), when 
using calibration material as control material, the 
laboratory must at least use calibration material 

| from a different lot than that used to establish a 

i cut-off value. 

493.1256(d)(10)(g} CONTROL PROCEDURES 


Unless CMS Approves a procedure, specified in 

| Appendix C of the State Operations Manual 
(CMS Pub. 7), that provides equivalent quality 
testing, the laboratory must-- 
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| Establish or verify the criteria for acceptability of 
ail control materials. 


| (i) When control materials providing quantitative 

results are used, statistical parameters (for 

example, mean and standard deviation) for each 

| batch and lot number of contral materials must be 

defined and available. 

(ii) The laboratory may use the stated value of a 

| commercially assayed control material provided 
the stated value is for the methodology and 

instrumentation employed by the laboratory and is 

verified by the laboratory. 

| (iii) Statistical parameters for unassayed control 

materials must be established over time by the 

laboratory through concurrent testing of control 

materials having previously determined statistical 

i parameters. 


(g) The laboratory must document all control 

| procedures performed. 

| This STANDARD is not met as evidenced by: 

1. Based on laboratory personnel interviews and 
complete blood counts (CBC) quality control 

| record review on September 23, 2015, the 
laboratory failed to verify the stated values of the 
commercially assayed CBC quality control 
materials in use at the time of the survey. 
Findings included: 


a. Itwas the practice of the laboratory to use 
commercially assayed CBC quality control 
materials to monitor patient CBC testing using 
two Drew 3 instruments.. 


b. Laboratory CBC quality control records 
indicated that on June 27, 2015 the laboratory 
changed the lot of quality control material from lot 
number EX045 to EX075. ; 
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c. The laboratory maintained no documentation 
to indicate that the stated values of CBC quality 

| control material lot number EX075 had been 
verified by the laboratory. 


d. According to laboratory personnel, between 
June 27, 2015 and September 24, 2015, the 

| laboratory used one of the Drew 3 instruments on 
30 different days to perform and report patient 
CBC specimens, and used the other Drew 3 
instrument on 87 different days to perform and 
report patient CBC specimens. 


2. Based on interview with the general 
supervisor and chemistry quality contro! (QC) 
records on November 17, 2015, the laboratory 
failed to verify the stated values of the 
commercially assayed QC material. Findings 
include: 


a. The general supervior stated that when a new 
lot number of QC was started, the QC ranges 
were entered into the chemistry analyzers (Advia 
1800 and Advia XPT) from the manufacturer's 
package insert just prior to use. 


|b. The general supervisor further stated that the 
| new lot number of QC was run one time prior to 
patient testing. 


'¢. QC records show that MultiQual lot number 
| 45660 was put into use in 2014 and discontinued 
in August 2015. 


id. The general supervisor and Director of 
Assays confirmed on 11/17/15 at 9:40 am that 
manufacturer's QC ranges for new lot numbers of 
chemistry controls were not verified. 
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493,1256(e)(4)(g) CONTROL PROCEDURES 


(e) For reagent, media, and supply checks, the 
laboratory must do the following: 


(e)(4) Before, or concurrent with the initial use-- 

| (e)(4)(i) Check each batch of media for sterility if 

| sterility is required for testing; 

| (e)(4) (ii) Check each batch of media for its ability 
_ to support growth and, as appropriate, select or 
inhibit specific organisms or produce a 
biochemical response; and 

| (e)(4) (iii) Docurnent the physical characteristics of 
the media when compromised and report any 

| deterioration in the media to the manufacturer. 


(g) The laboratory must document ali control 
procedures performed. 

This STANDARD is not met as evidenced by: 
Based on technical supervisor interview and 
bacteriology media quality control record review 
on November 18, 2015, the laboratory failed to 
check each batch of media for its ability to 
support growth before or concurrent with initial 
use. Findings included: 


a. From November 15, 2015 to November 18, 
2015, the laboratory performed patient 
bacteriology testing using Hardy blood agar 
plates (BAP), lot number 15300, expiration date 
01/25/2016. 


b. For this lot of BAP, the laboratory relied on 

manufacturer's documentation that the 

manufacturer performed quality control 

procedures on the BAP. The laboratory did not, 

before or concurrent with initial use, performed 

any quality control procedures to check whether 
this lot of BAP supported organism growth. 
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c. From November 15, 2015 to November 18, 
2015, the laboratory performed 12 patient 
specimen cultures using Hardy BAP, lot number 
15300, expiration date 01/25/2016. 
493.1256(f}(g) CONTROL PROCEDURES 


(f} Results of contro! materials must meet the 
laboratory's and, as applicable, the 
manufacturer's test system criteria for 
acceptability before reporting patient test results. 


(g) The laboratory must document all control 
procedures performed. 
This STANDARD is not met as evidenced by: 

1. Based on review of the prothrombin 
time/international normalized ratio (PT/INR) 
procedure, quality control (QC) records, patient 
results and interview with the general supervisor, 
the laboratory failed to ensure that the QC for 
PT/INR was acceptable prior to reporting patient 
results from April 2015 through September 2015. 
Findings include: 


1a. CL SOP-10001 Revision A, "Measuring 
Prothrombin Time-innovin (PT on the Siemens 
BCS XP Instrument" stated on page 6, section 
8.6 that if control values are outside of the 
determined range, the controls, reagents and 

| instrument performance should be checked and 
| that identification and correction of the problem 
shoud be documented prior to reporting patient 
results. 


b. QC records for Citrol 3 (Lot number 548425) 
| were reviewed from 4/1/15 through 9/23/15. 


| c. The general supervisor stated that QC was 
acceptable if the values were +/- 2 SD from the 
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mean, 


d. On 9/7/15, Citrol 3 was run seven times 
without obtaining an acceptable QC value. 


e. On 9/8/15, Citrol 3 was run twelve times 
| without obtaining an acceptable QC value. 


f. On 25 of 32 days, Citrol 3 was not rerun 
when the QC value was greater than - 2 SD. 


g. On 5/15/15, 8/13/15, 8/21/15 and 9/10/15, 
Citrol 3 was run twice. All QC results were 
unacceptable. 


/h. The Rule Check report revealed that 13 of 13 
: QC values in April 2015, 2 of 17 in May 2015, 7 of 
7 in June 2015, 13 of 13 in July 2015, 16 of 16 in 
August, and 24 of 24 during September 1-16, 

' 2015 showed rule violation messages related to 

| Citrol 3. 


i. 81 patients were reported from 4/1/15 
through 9/16/15. 


2. Based on review of the quality contro! (QC) 
procedure, QC records, and raw data from 
patient test runs and interview with the general 
supervisor, the laboratory failed to ensure that the | 
QC was acceptable for the Theranos Proprietary | 
System (TPS) prior to reporting patient test 
results: Findings include: 


a. CL SOP-15026 Revision A, "Edison 3.5 

Theranos System Daily QC Procedures”, stated 
the following in section 10.1.1: "...For any single 
Edison instrument, reject QC if either level is | 
greater than 2 SD or if either level falls on the 
same side of the mean for 10 consecutive days." | 
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b. Section 11.1.1 of CL SOP-15026 Revision A 
further stated that "Daily QC automatically 
expires 24 hours after use." 


c. The general supervisor stated that when the 
QC was unacceptable, the TPS device locked out 
patient testing for 24 hours or until the QC was 
acceptable and if the QC was unacceptable 
another device would be used for testing. 


d. QC records for Sex Hormone Binding 
Globulin (SHBG) showed that on Device 001025 
QC Level 2's (QC2) 24 hour expiration was on 
8/14/14 at 18:54 and was not run again until 
8/15/14 at 00:05. Patient data showed that 
patient Accession #94389 was run on 8/14/14 at 
19:09. 


e. QC records for SHBG showed that on Device 
E001025 QC Level 1's (QC1) 24 hour expiration 
was on 8/20/14 at 17:43 and was not run again 
until 8/21/14 at 17:50. Patient data showed that 
patient Accession #95403 was run on 8/20/14 at 
19:08. 


f QC records for SHBG showed that on Device 
E001036 QC1 was not run again until 11/1/14 at 
22:15. Patient data showed that patient 
Accession #112807 was run on 11/1/14 at 00:02. 


g. QC records for Vitamin B12 (VB12) showed 

| that on Device E000027 QC1 was run on 8/16/14 
_ at 06:16 and failed. QC1 was next run 8/17/14 at 
09:10 and passed. QC2 was not run on 8/15/14 

_ or 8/16/14. Patient data showed that patient 

| Accession #94598 was run on 8/16/14 at 00:48. 


| h. QC records for VB12 showed that on Device 
Event 1D: W34211 
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E000027 QC1 was run on 8/16/14 at 06:16 and 
failed. QC1 was next run 8/17/14 at 09:10 and 
passed. QC2 was not run on 8/15/14 or 8/16/14. 
Patient data showed that patient Accession 
#94598 was run on 8/16/14 at 00:48. 


i. QC records for VB12 showed that on Device 
E000027 QC2 24 hour expiration was on 8/19/14 
at 08:00 and was not run again until 8/20/14 at 
21:05. Patient data showed that 3 patients 
(Accession #s 95411, 95462, 95543) were run on 
8/20/14 between 12:33 and 17:52. 


j. QC records for VB12 showed that on Device 
£000027 QC2 24 hour expiration was on 8/22/14 
at 17:38 and was not run again until 8/23/14 at 
21:05. Patient data showed that 2 patients 
(Accession #s 96984, 96106) were run on 
8/22/14 at 18:56 and 21:21. 


k. QC records for VB12 showed that on Device 
E000027 QC1's 24 hour expiration was on 
8/24/14 at 16:43 and was not run again until 
8/25/14 at 07:59. QC2 24 hour expiration was on 
8/24/14 at 21:05 and was not run again until 
8/25/14 at 12:23. Patient data showed that 3 
patients (Accession #s 96327, 96250, 96371) 
were run on 8/24/14 between 17:15 and 21:36. 


|. QC records for VB12 showed that on Device 
E000037 QC1 had a “10x warning" message in 
the QC Pass/Fail Status column on 2/25/15 at 
20:29 and again on 2/26/15 at 20:22, QC2 hada 
| "10x warning" message in the QC Pass/Fail 

, Status column on 2/25/15 at 22:11 and again on 
2/26/15 at 22:04. QC1 passed on 2/27/15 at 
22:54 and QC2 was run and passed on 2/28/15 
at 00:27. Patient data snowed that 7 patients 

' (Accession #s 146275, 146391, 146651, 146852, 
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147149, 146596, 146898) were run between 
2/26/15 and 2/27/15 during the time the 
laboratory had a 10x warning. 


/m. QC records for VB12 showed that on Device 
/ E001000 QC1's 24 hour expiration was on 

| 1/25/15 at 21:58 and was not run again until 

| 1/28/15 at 2140. QC2 24 hour expiration was on 
| 1/26/15 at 02:22 and was not run again until 

| 1/28/15 at 23:19. Patient data showed that 5 
patients (Accession #s 136351, 136139, 136386, 
136897, 135548) were run between 1/27/15 at 
1359 and 1/28/15 at 11:50. 


n. QC records for Vitamin D, 25-OH (VitD) 
showed that on Device E001059 QC1's 24 hour 
expiration was on 7/6/14 at 14:11 and was not run 
again until 7/7/15 at 08:04. Patient data showed 
that Accession #88699 was run on 7/6/14 at 
14:31, 


o, Levey-Jennings charts revealed that SHBG 
Device E000026 QC1 had 13 consecutive days 
and QC2 had 15 consecutive days that the 
results were at least 2 standard deviations (SDs) 
below the mean from 9/30/14 through 10/29/14. 


p. Levey-Jennings charts revealed that SHBG 
Device E001007 QC1 had 19 consecutive days 
that the results were at least 2 SDs below the 
mean from 3/31/15 through 4/29/15. 


q. Levey-Jennings charts revealed that VitD 
Device E001059 QC1 had 15 consecutive days 
that the results were at least 2 SDs above the 
mean from 6/30/15 through 7/25/14. 


|r. Levey-Jennings charts revealed that Total T3 
| (TT3) Device E000195 QC1 had 11 consecutive 
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days that the results were at least 2 SDs above 
the mean from 1/3/15 through 1/29/15. 


s. Levey-Jennings charts revealed that TT3 
Device E001032 QC1 had 113 consecutive days 
and QC2 had 12 consecutive days that the 
results were at least 2 SDs above the mean from 
| 7/9/14 through 7/25/14. 


t. Levey-Jennings charts revealed that VB12 
Device E000187 QC1 had 14 consecutive days 

| and QC2 had 12 consecutive days that the 

| results were at least 2 SDs above the mean from 
| 2/10/14 through 2/27/14. 

493.1281(a)(c) COMPARISON OF TEST 
RESULTS 


(a) lf a laboratory performs the same test using 
different methodologies or instruments, or 
performs the same test at multiple testing sites, 
| the laboratory must have a system that twice a 
| year evaluates and defines the relationship 
between test results using the different 
methodologies, instruments, or testing sites. 
| (c) The laboratory must document all test result 
_ comparison activities. 

i This STANDARD is not met as evidenced by: 

1, Based on laboratory personnel interview and 
manual WBC differential record review on 
| November 19, 2015, the laboratory failed to have 
a system that twice a year evaluated and defined 
the relationship between WBC differential test 
results examined by multiple testing personnel. 
Findings included: 


a. It was the practice of the laboratory for 
multiple testing personnel to examine and report 
patient WBC differentials from stained slides. 
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b. The laboratory had no system that twice a 
year evaluated and defined the relationship 
between WBC differential test results examined 
by multiple testing personnel. Other than through | 
the distribution of proficiency testing samples, the 
laboratory had no documentation to indicate | 
whether testing personnel were examining patient | 
stained slides and reporting patient manual WBC | 
differential similarly, accurately, and reliably. 


2. Based on review of documentation, the 
laboratory failed to have a system that twice a 
year evaluated and defined the relationship 
between the Theranos Proprietary System (TPS) | 
to a predicate instrument. Findings include: 


a. Undated documentation provided by the | 
laboratory revealed a comparison study between | 
the Theranos Proprietary System (TPS) (i.e., 
Edison) and a predicate device (immulite, 
Centaur, or Liaison) for Sex Hormone Binding 
Globulin (SHBG), Total T3 (TT3), Vitamin D (VitD) 
and Vitamin B12 (VB12). 


b. The method comparison documentation 
showed that the following devices (i.¢., readers) 
E000026, E001025 and E001036 were used for 
SHBG comparison testing. SHBG testing 
occurred from 7/28/14 through 6/25/15. 


c. Quality control (QC) monthly reports revealed | 
that seven devices were used for SHBG from 
February 2015 through June 2015 but only three 
devices were included in the comparison study. 


d. QC and patient result documentation for 
SHBG also revealed that devices E000040, 
E001007 and E001035 were used for patient 
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testing and were not included in the comparison 
study. 


e. The method comparison documentation 
showed that the following devices E0Q00162, 
E000187, £00195, E001011, E001032, and 
E001049 were used for TTS testing. TT3 testing 
occurred from 2/2/14 through 2/4/15. 


f. The method comparison documentation 
showed that the following devices EQ00053, 
E£000072, £00101, E0001157, E001007, 
E001043, and E001059 were used for VitD 
testing. VitD testing occurred from 11/6/13 
through 3/10/15. 


g. Quality control (QC) monthly reports revealed 
that twelve devices were used for VitD in 
February 2015 and eighteen devices were used 
from March 2015 through April 2015 but only 
seven devices were included in the comparison 
study. 


h. QC and patient result documentation for VitD 
also reveaied that device EQ001059 was used for 
patient testing and was not included in the 
comparison study. 


i. The method comparison documentation 
showed that the following devices EQ00053, 
E000072, E00101, £0001157, E001007, 
E001043, and E001059 were used for VB12 
testing. VB12 testing occurred from 8/12/14 
through 3/6/15. 


j. Quality contro! (QC) monthly reports revealed 
that twelve devices were used for VB12 in 
October 2014 and February 2015 through April 
2015 but only eleven devices were included in the 
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D5775 | Continued From page 43 
| comparison study. 
D5779 | 493.1282(a) CORRECTIVE ACTIONS 


400B | Corrective action policies and procedures must 
| be available and followed as necessary to 
maintain the laboratory's operation for testing 
patient specimens in a manner that ensures 
accurate and reliable patient test results and 
reporis. 


This STANDARD is not met as evidenced by: 
Based on laboratory personnel interviews and 
complete blood counts (CBC) quality control 
record review on September 23, 2015, the 
laboratory failed to follow corrective action 
policies and procedures as necessary to maintain 
the laboratory's operation for testing patient CBC 
specimens in a manner that ensure accurate and 
reliable patient test results and reports when the 
laboratory's criteria for acceptability of CBC 
quality control material test results were not met. 
Findings included: 


a. It was the practice of the laboratory to test 
three levels (low, normal, and high) of quality 
control materials each day of patient testing and | 
to use the stated values of commercially assayed | 
| 


quality control materials to monitor patient CBC 
testing using the Drew 3 instruments. In the 
event any CBC quality control material test results | 
did not fall within the stated assay values, | 
laboratory personnel were to follow the procedure | 
detailed in the protocol titled “Quality Control 
(document number CL QOP-00013, revision F)." 


i. "Step 1" of the procedure was to “rerun the 
controls." 
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D779 Continued From page 44 
ii, "Step 2" of the procedure was to "repeat with 
_ fresh controis" “if the rerun of controls failed." 


| ili. “Step 3" of the procedure was to "check the 
i operation of the instrument" "if the rerun of [fresh] 
controls failed." 


iv. “Step 4" of the procedure was to “repeat 
using a new reagent kit" and "recalibrate" if 
quality control test results continued to fall outside 
the laboratory's criteria for acceptability. 


v, “Step 5" of the procedure was to "call | 
instrument support and inform [the] supervisor" if | 
quality control test results continued to fall outside | 
the laboratory's criteria for acceptability. | 


b, Laboratory records for the Drew 3 instrument 
the laboratory designated as “Drew #2" indicated 
that on July 11, 12, 14, and 16, 2015 CBC quality 
control material test results failed to meet stated 
assay values. The laboratory's documentation of 
these quality control failures indicated that the 
laboratory's "Quality Control" protocol was not 
followed. 


i. On July 12, 2015, laboratory records 
indicated that the high quality contro! material 
failed to meet the laboratory's criteria for 
acceptability (specific CBC analyte not 
designated). Testing of the high quality control 

| material was repeated three times before being 

| acceptable using a "new QC tube." "Step 1" was 
| repeated three times before the laboratory 
followed "Step 2.” 


ii. On July 16, 2015, laboratory records 
indicated that the high quality control material 
failed to meet the laboratory's criteria for 
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acceptability (specific CBC analyte not 
designated). Testing of the high quality control 
material was repeated two times before being 
acceptable on a third repeat. “Step 1" was 
repeated two times without following “Step 2." 


iii, On July 17, 2015, laboratory records 
indicated that the high quality control material 
failed to meet the laboratory's criteria for 
acceptability (specific CBC analyte not 

| designated). Testing of the high quality control 
material was repeated two times before being 
| acceptable on a third repeat. “Step 1° was 

| repeated two times without following "Step 2." 


| [NOTE: On July 11 and 14, 2015, laboratory 
records also indicated that the high quality control 
| material failed to meet the laboratory's criteria for 
acceptability (specific CBC analyte not 
designated). Testing was repeated and was 
acceptable. “Step 1" was followed.] 


[NOTE: On July 14, 2015, laboratory records also 
indicated that the normal quality contro! material 
failed to meet the laboratory's criteria for 
acceptability (specific CBC analyte not 
designated). Testing was repeated and was 
acceptable. "Step 1" was followed.] 


c. Laboratory records indicated that the Drew 3 
instrument the laboratory designated as "Drew 
#2" was used to test and report 36 patient CBC 
specimens on July 11, 2015, 12 patient CBC 
specimens on July 12, 2015, 36 patient CBC 
specimens on July 14, 2015, and 45 patient CBC 
specimens on July 16, 2015. Itis unknown how 
many patient CBC specimens were tested using 
"Drew #2" on July 17, 2015. 
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| Continued From page 46 
493.1283(a) TEST RECORDS 


The laboratory must maintain an information or 
record system that includes the following: 

| (a)(1) The positive identification of the specimen. 
{a)(2) The date and time of specimen receipt into 
' the laboratory. 

(a}(3) The condition and disposition of specimens 
that do not meet the laboratory's criteria for 

| specimen acceptability. 

(a)(4) The records and dates of all specimen 

| testing, including the identity of the personnel who 
performed the test(s). 

: This STANDARD is not met as evidenced by: 

| Based on technical supervisor interview and 
bacteriology media quality control record review 

, on November 18, 2015, the laboratory failed to 
have an information or record system that 
included the records of all bacteriology patient 
specimen testing. Findings included: 


Although the laboratory maintained 
documentation to indicate that all lots of 
bacteriology media used to test patient 
bacteriology specimens had been quality 
controlled by the manufacturer or laboratory, the 
laboratory maintained no documentation of the lot 
of media used to test any given patient | 
bacteriology specimen. The laboratory 
maintained no such information or record system. 
493.1289(a)(c) ANALYTIC SYSTEMS QUALITY 
ASSESSMENT 


(a} The laboratory must establish and follow 
written policies and procedures for an ongoing 
mechanism to monitor, assess, and when 
indicated, correct problems identified in the 
analytic systems specified in 
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§§493.1251 through 493.1283. 

| (c) The laboratory must document all analytic 
systems assessment activities. 


This STANDARD is not met as evidenced by: 

| 1. Based on the SensoScientific Monitoring 
Audit Node Report and intervew, the laboratory 
i failed to identify and perform corrective action 
when ten of ten freezer temperatures did not 

| meet the manufacturer temperature 
requirements. Findings include: 


a. The Audit Node Reports for July 2015 and 
September 2015 were reviewed. 


b. Six -20 C freezers were identified: 7059 -20 
Freezer Sanyo JP lab, 7061 BUGS -20 Freezer 4, 


1 Normandy, 7075 -20 Freezer 2 JP, and 7077 
-20 Freezer 3JP. 


Freezer 1 Nuair, 7111 -80 Freezer 2 Thermo, 
7113 -80 Freezer 2 CLIA Lab, and 7120 -80 
Freezer 1 BUGS. 


d. The Audit Node Report for 7/6/15 through 
7/31/15 revealed the following number of days 
that the freezers did not meet the required 
acceptable temperature range of greater than or 
equal to -20 C or greater that or equal to -80 C: 


7059 -20 Freezer Sanyo JP Lab 25/26 days 
7098 -80 Freezer 1 Nuair 7/26 days 

| 7111 -80 Freezer 2 Thermo 18/26 days 
7113 -80 Freezer2 CLIALab 14/26 days 
| 7120 -80 Freezer 1 BUGS 25/26 days 


1@, The Audit Node Report for 9/1/15 through 
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9/24/15 revealed the following number of days 

' that the freezers did not meet the required 

acceptable temperature range of greater than or 
equal to -20 C or greater that or equal to -80 C: 


7059 -20 Freezer Sanyo JP Lab 12/24 days 
7061 BUGS -20 Freezer 4 12/24 days 
| 7063 -20 Freezer Accessioning 11/24 days 

7066 -20 Freezer 1 Normandy 9/24 days 
| 7075 -20 Freezer 2 JP 6/24 days 
| 7077 -20 Freezer 3JP 5/24 days 
7098 -80 Freezer 1 Nuair 11/24 days 
7111 -80 Freezer 2 Thermo 3/24 days 
7113 -80 Freezer2 CLIALab 10/24 days 
7120 -80 Freezer 1 BUGS 18/24 days 


f. The Quality Assurance Quality Control 
Manager signed and dated the Audit Node 
Reports. The Quality Assurance Quality Control | 
Manager could not explain if any corrective action | 
was taken. 


g. There was no documenation that the 
laboratory identified the days that the freezers did 
not meet the acceptable ternperature ranges and 
did not take any corrective action for those days. 


h. Refer to D5413. 


2. Based on review of Quality Control (QC) data 
and Monthly QC Reports, the laboratory failed to 
have a quality assessment (QA) procedure to 
identify and correct problem with the QC values 
for the Theranos Proprietary System (TPS) when 
| precision did not meet the laboratory's 
requirement for precision. Findings include: 


'a. CL PLN-14003 Revision A, "Master Validation 
Plan for Routine Chemistry Assays on Theranos 
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Devices" in section 13.4.5 requires the %CV of 


replicates to be not more than 15% (20% at the 
lower and upper limits of detection). 


b. QC results were reviewed from June 2014 
through November 2014 and January through 
February 2015 for Vitamin B12 (VB12), Vitamin D 
(VitD), and Sex Hormone Binding Globuin 
(SHBG) which were used for patient testing on 

| the TPS devices. 


|c. VB12 QC Level 1 and Level 3 (QC1 and 
| QC3) on Device E000110 revealed the following 


%CV (coefficient of variation): 34.3% and 48.5%, 
| respectively, from 1/5/15 through 1/30/15. 


d. VB12 QC1 and QC3 on Device E001085 
| revealed the following %CVs: 52.5% and 35.2%, 
respectively, from 1/5/15 through 1/30/15. 


e. VB12 QCi and QC3 on Device E001102 
revealed the following %CVs: 39.0% and 20.0%, 
respectively, from 2/10/15 through 2/27/15. 


f. VB12 QC1 and QC3 on Device E001000 
revealed the following %CVs: 34.7% and 39.9%, 
respectively, from 1/2/15 through 1/31/15. 


g. VBi12 QC1 and QC3 on Device E001102 
revealed the following %CVs: 39.0% and 20.0%, 
respectively, from 2/10/15 through 2/27/15. 


h. VitD QC Level 1 and Level 2 (QC1 and QC2) | 
on Device E000053 revealed the following %CVs: | 
63.8% and 26.4%, respectively, from 8/21/14 
through 8/30/14. 


ii. Vit~D QC1 and QC2 on Device E001059 
| revealed the following %CVs: 18.7% and 18.7%, 
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respectively, from 6/29/14 through 7/24/14. | | 


|j.  VitD QC1 and QC2 on Device E001043 
revealed the following %CVs: 25.2% and 31.9%, 
| respectively, from 6/29/14 through 7/25/14. 


k. SHBG QC1 on Device E001026 revealed the 
| following %CV: 18.9% from 9/30/14 through 
| 11/5/14. 


‘1. SHBG QC1 on Device EQ01025 revealed the 
| following %CV: 21.2% from 7/31/14 through 
8/28/14, 


| 3. Based on review of Quality Assessment (QA) 
documentation and QA procedures, the 
laboratory failed to have a quality assessment 
(QA) procedure established to identify and correct 
problems with the Quality Control (QC) program 
for the Theranos Proprietary System (TPS) . 
Findings include: 


a. Monthly QC reports were reviewed for July 
2014, October 2014, and February through June 
2015. 


b. All reports were signed by the laboratory 
director (LD) on 9/19/15, except the March 2015 
report was signed by the LD on 11/19/15. 


c. The total percentage of QC values greater 
than 2 standard deviations (SDs) was reviewed 
by the surveyor. 


d. The July 2014 report indicated in the 
summary that 2179 controls had been run on the | 
"Edison**" devices; however, the specific report 
' on the "Edison**" device showed that only 1618 
were run on all tests and all devices. 
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e. In July 2014, the data revealed the following 
tests showed percentage of QC samples with 
more than 15% of values greater than 2 SD: 
Testosterone (TST) (28%), Total T4 (TT4) (21%), 
VitD (28%). Overall 16% of QC samples on all 
tests on all devices had values greater than 2 
SDs. 


f. In October 2014, the data revealed the 
' following tests showed percentage of QC 
samples with more than 15% of values greater 
| than 2 SD: Estradiol (EST) (33%), Free T4 (FT4) 
(19%), Prolactin (PRLN) (47%), SHBG (45%), 
i Thyroid Stimulating Hormone (TSH) (26%), TST 
| (45%), Total T3 (TT3) (32%), TT4 (28%), VitD 
| (19%), VB12 (46%). Overall 29% of QC samples 
on all tests on all devices had values greater than | 
25Ds. | 
g. In February 2015, the data revealed the 
following tests showed percentage of QC 
samples with more than 15% of values greater | 
than 2 SD: FT4 (26%), SHBG (87%), TT3 (33%), | 
VitD (24%), VB12 (20%). Overall 24% of QC 
samples on all tests on all devices had values 
greater than 2 SDs. 


h. in March 2015, the data revealed the 
following tests showed percentage of QC 
samples with more than 15% of values greater 
than 2 SD: SHBG (42%), TSH (20%). Overall 
20% of QC samples on all tests on all devices 
had values greater than 2 SDs. 


i. In April 2015, the data revealed the following 
tests showed percentage of QC samples with 
more than 15% of values greater than 2 SD: 

| SHBG (16%), total Prostate Specific Antigen 
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(tPSA) (22%), VB12 (60%). Overail 21% of QC 
| samples on ail tests on all devices had values 
| greater than 2 SDs. 


/j. dn May 2015, the data revealed the following 
tests showed percentage of QC samples with 

| more than 15% of vaiues greater than 2 SD: 
SHBG (34%), tPSA (22%). Overall 26% of OC 

| samples on ail tests on all devices had values 

| greater than 2 SDs, 


'k. In June 2015, the data revealed the following 
tests showed percentage of QC samples with 

| more than 15% of values greater than 2 SD: 

, SHBG (23%). Overall 14% of QC samples on all 
tests on all devices had values greater than 2 

, SDs. 


4. Based on review of the quarterly Quality 
Assessment (QA) Power Points and interview 
with the QA/Quality Control (QC) Manager, the 
laboratory failed to identify and correct problems 
with drawing patient specimens. Findings include: 


a. The QA/AC Manager stated that a Power 

Point presentation was prepared and presented 
to specific staff each quarter and that no minutes | 
or corrective actions were documented. 


b. The QApresentation from the 3rd quarter 
2014 showed that the number 1 reason that 
patient specimens had to be redrawn was clots 
(293). 


c. The QApresentation from the 1st quarter 
2015 showed that the number 1 reason that 
patient specimens had to be redrawn was clots 


(246). 
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d. The QApresentation from the 2nd quarter 
2015 showed that the number 1 reason that 
patient specimens had to be redrawn was clots 
(116). 


6. There was no documentation which showed 
that the lab had identified the large number of 
redraws due to clots or that any action had been 
taken to correct the number of redraws due to 
clots. 

493.1289(b)(c) ANALYTIC SYSTEMS QUALITY 
ASSESSMENT 


(b) The analytic systems quality assessment must 
include a review of the effectiveness of corrective 
| actions taken to resolve problems, revision of 
policies and procedures necessary to prevent 

| recurrence of problems, and discussion of 

| analytic systems quality assessment reviews with 
appropriate staff. 

| (c) The laboratory must document all analytic 
systems assessment activities. 

| This STANDARD is not met as evidenced by: 

{. Based on laboratory personnel interviews and 
| complete blood counts (CBC) quality control and 
calibration record review on September 23, 2015, 
the laboratory failed to have an analytic systems 
quality assessment mechanism that included a 
review of the effectiveness of the laboratory's 
CBC processes. Finding included: 


a. The laboratory's Siemens Advia 2120i 
procedure failed to include the corrective actions 
to be taken when calibration or quality control 
results failed to meet the laboratory's criteria for 
acceptability. See D5403. 


b. The laboratory's quality assessment 
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mechanism failed to ensure that all CBC 
calibration documentation was maintained. See 
| D5437. 


c. The laboratory's quality assessment 

| mechanism failed to ensure that the stated values 
of commercially assayed CBC quality control 

_ materials were verified. See D5469. 


d. The laboratory's quality assessment 

| mechanism failed to ensure that laboratory 
personnel followed the established corrective 
action protocol when CBC quality control test 

i resuits failed to meet the laboratory's criteria for 
acceptability even though the laboratory 
maintained documentation to indicate that the 
documented CBC quality control corrective 
actions had been reviewed during a quality 
assessment audit on August 6, 2015. In addition, 
the laboratory maintained no documentation it 
had recognized and investigated possible 
probiems with the high quality control material 
being used as it had failed to meet the 
laboratory's criteria for acceptability upon initial 
testing for 5 of 7 days of patient specimen testing 
from July 11, 2015 to July 17, 2015. See D5779. 


; 2. Based on laboratory personnel interviews and 
WBC differential flow cytometer performance 
report record review on November 17, 2015, the 

| laboratory failed to have an analytic systems 
quality assessment mechanism that included a 
review of the effectiveness of flow cytometer 

| corrective actions taken to resolve problems. 
Findings included: 


la. For patient capillary specimens, it was the 
practice of the laboratory to use flow cytometry 
instrumentation to perform and report patient 
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b. On August 23, 2015, in which the flow 
cytometer was used to perform and report patient 
WBC differentials, laboratory "Cytometer | 
Performance Reports” indicated that at 09:30 the 
flow cytometer performance check failed. The 
performance check was repeated and again 
failed at 10:18. At 12:49, laboratory 
documentation indicated that the flow cytometer 
performance check passed. 


c, The laboratory maintained no documentation 
to indicate that the actions taken on August 23, 
2015 to "pass" the flow cytometer performance 
check had been reviewed for the effectiveness of 


| the actions under the laboratory's quality 
_ assessment mechanism. 


3. Based on technical supervisor interviews and 
human chorionic gonadotropin (HCG) quality 


control record review on November 19, 2075, the 
laboratory failed to have an analytic systems 


quality assessment mechanism that included a 


| review of the effectiveness of HCG quality control 
| corrective actions taken to resolve problems. 


Findings included: 


a. it was the practice of the laboratory to use the 
immulite 2000 XPi instrument fo perform and 
report patient quantitative HCG test results. It 
was also the practice of the ijaboratory to use 
three levels of assayed quality control materials 
and the stated values of the commercially 
assayed quality contral materials as the 
laboratory's criteria for acceptability to monitor 
patient quantitative HCG testing. 


b. Areview of the criteria for acceptability for the | 
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three quality control materials (Bio-Rad, lot 
number 40310, expiration date 12/31/2017) in 


| use on November 19, 2015 indicated that for the 


level 1 quality control material the criteria for 


' acceptability used to monitor patient HCG testing 
| was 9.38 - 14.4 miU/mL, the level 2 quality 


control material's criteria for acceptability used to 


| monitor patient HCG testing was 20.6 - 32.4 


mlU/mL, and the level 3 quality contral material's 
criteria for acceptability used to monitor patient 


| HCG testing was 264 - 376. 


c. According to the manufacturer's package 


| insert, the assayed values of the three quality 


contro! materials in use on November 19, 2015 to 
monitor patient HCG testing was 8.66 - 18.2 
mlU/mL for level 1, 21.6 - 40.6 mlU/mL for level 
2, and 306 - 460 mlU/mL for level 3. 


d. According to laboratory records, the criteria 
for acceptability for the three quality control 
materials in use on November 19, 2015 to 
monitor patient HCG testing was changed on 
September 11, 2015 to the criteria for 
acceptability that was used until November 19, 
2015. According to laboratory personnel, the 
change to the criteria for acceptability was made 
on September 11, 2015 because there was an 
apparent "shift" in the laboratory's quality control 
materials test results. The laboratory conducted 
no further investigation or review prior to 
changing the criteria for acceptability for the three 
quality control materials. 


'@. The laboratory's change of the criteria for 


acceptability for the two of the three HCG quaiity 
control materials resulted in criteria for 


| acceptability outside the criteria established by 


the manufacturer. The laboratory maintained no 
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mechanism to assess the effectiveness of this 
corrective action. 


f. From September 11, 2015 to November 19, 
2015, the laboratory performed and reported 19 
patient quantitative HCG tests. 


4, Based on technical supervisor interviews and 
hepatitis B survey antibody (HBsAb) quality 
control record review on November 19, 2015, the 
laboratory failed to have an analytic systems 
quality assessment mechanism that included a 
review of the effectiveness of HBsAb quality 
control corrective actions taken to resolve 
problems. Findings included: 


a. lt was the practice of the laboratory to use the | 
lmmulite 2000 XPi instrument to perform and | 
report patient HBsAb test results. It was also the | 
practice of the laboratory to use three levels of 
assayed quality control materials and the stated 
values of the commercially assayed quality 
contro] materials as the laboratory's criteria for 
acceptability to monitor patient HBsAb testing. 


b. Areview of the criteria for acceptability for the 
three quality control materials (Siemens, lot 
number 0134, expiration date 11/2016) in use on 
November 19, 2015 indicated that for the 
negative quality control material the criteria for 
acceptability used to monitor patient HBsAb 

i testing was 0.0 - 4.0, the low positive quality 

_ control material's criteria for acceptability used to 
| monitor patient HBsAb testing was 10.3 - 19.6, 
and the positive quality contro! material's criteria 
for acceptability used to monitor patient HBsAb 
testing was 234 - 3465. 


c. According to the manufacturer's package 
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insert, the assayed values of the three quality 
control materials in use on November 19, 2015 to 
monitor patient HBsAb testing was 0.0 - 4.0 for 
the negative quality contro! material, 11 - 21 for 
the low positive quality control material, and 226 - 
340 for the positive quality contro! material. 


d. According to laboratory records, the criteria 
for acceptability for two of the three quality control 
materials in use on November 19, 2015 to 
monitor patient HBsAb testing was changed on 
September 11, 2015 to the criteria for 

| acceptability that was used until November 19, 

| 2015. According to laboratory personnel, the 
change to the criteria for acceptability was made 
on September 11, 2015 because there was an 
apparent "shift" in the laboratory's quality control 
materials test results. The laboratory conducted 

| no further investigation or review prior to 

_ changing the criteria for acceptability for the three 
quality control materials. 


e. The laboratory's change of the criteria for 
acceptability for the two of the three HBsAb 

i quality control materials resulted in criteria for 
acceptability outside the criteria established by 
the manufacturer. The laboratory maintained no 
mechanism to assess the effectiveness of this 
corrective action. 


| 


f. From September 11, 2015 to November 19, 
2015, the laboratory performed and reported 16 
patient HBsAb tests. 


5. Based on technical supervisor interviews and 
luteinizing hormone (LH) quality control record 
review on November 19, 2015, the laboratory 
failed to have an analytic systems quality 
assessment mechanism that included a review of 
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the effectiveness of LH quality control corrective 
| actions taken to resolve problems. Findings 

included: 
/ a. It was the practice of the laboratory to use the | 
Siemens Advia Centaur XP Immunoassay | 
System instrument to perform and report patient 
LH test results. It was also the practice of the 
laboratory to use three levels of assayed quality 
control materials and the stated values of the 
commercially assayed quality control materials as | 
the laboratory's criteria for acceptability to monitor 
patient LH testing. 


b. Areview of the criteria for acceptability for the 
three quality control materials (Bio-Rad, lot 
number 50980, expiration date 11/30/2016) in 
use on November 19, 2015 indicated that for the 
level 1 quality control material the criteria for 
acceptability used to monitor patient LH testing 

| was 2.86 - 4.18 miU/mL, the level 2 quality 
control material's criteria for acceptability used to 
i monitor patient LH testing was 16.98 - 25.48 
_mlU/mL, and the level 3 quality control material's 
criteria for acceptability used to monitor patient 

| LH testing was 57.6 - 84.8 mlU/mL. 


c. According to the manufacturer's package 

| insert, the assayed values of the three quality 

i contro! materials in use on November 19, 2015 to 
monitor patient LH testing was 2.86 - 4.18 
mlU/mL for level 1, 16.6 - 23.9 mIU/mL for level 
2, and 57.6 - 84.8 miU/mL for level 3. 


i 


d. According to laboratory records, the criteria 
for acceptability for one of the three quality control, 
materials in use on November 19, 2015 to 

monitor patient LH testing was changed on July 9, 
2075 to the criteria for acceptability that was used 
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until November 19, 2015. According to laboratory 
personnel, the change to the criteria for 
acceptability was made on July 9, 2015 because 
there was an apparent "shift" in the laboratory's 
quality control materials test results. The 
laboratory conducted no further investigation or 
review prior to changing the criteria for 
acceptability for the three quality control 
materials. 


e. The laboratory's change of the criteria for 
acceptability for the one of the three LH quality 
control materials resulted in criteria for 
acceptability outside the criteria established by 
the manufacturer. The laboratory maintained no 
mechanism to assess the effectiveness of this 
corrective action. 


f. From July 9, 2015 to November 19, 2015, the 
laboratory performed and reported 132 patient LH 
tests. 


6. Based on technical supervisor interviews and 
| CA-125 quality control record review on 
November 19, 2015, the laboratory failed to have 
| an analytic systems quality assessment 
mechanism that included a review of the 
effectiveness of CA-125 quality control corrective 
actions taken to resolve problems. Findings 

| included: 


ia. [twas the practice of the laboratory to use the 
Immulite 2000 XPi instrument fo perform and 

| report patient CA-125 test results. It was also the 
| practice of the laboratory to use three levels of 

| assayed quality control materials and the stated 

| values of the commerciaily assayed quality 

i control materials as the laboratory's criteria for 
acceptability to monitor patient CA-125 testing. 
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|b. Areview of the criteria for acceptability for the 

three quality control materials (Bio-Rad, lot 

‘number 19980, expiration date 09/30/2016) in 

use on November 19, 2075 indicated that for the 

| level 1 quality control material the criteria for 

| acceptability used to monitor patient CA-125 

testing was 18.6 - 28.7 U/mL, the level 2 quality 

' control material's criteria for acceptability used to 

monitor patient CA-125 testing was 53.5 - 82.2 

| U/mL, and the level 3 quality control material's 

| criteria for acceptability used to monitor patient 
CA-125 testing was 92.5 - 141 U/mL. 


c. According to the manufacturer's package 
insert for quality control materials Bio-Rad, lot 
i number 19980, there were no assayed values for 
the three quality control materials in use on 
November 19, 2015 to monitor patient CA-125. 
According to laboratory personnel, the quality 
control material's manufacturer could not publish 
the criteria for acceptability at the time the quality 
control material was received by the laboratory, 
and was told by the manufacturer to use the 
criteria for acceptability from the previous lot of 
quality control materials. The laboratory 
maintained no documentation to support the 
manufacturer's instructions for the use of the 
criteria for acceptability from the previous lot of 
quality control materials. 


d. Areview of the manufacturer's criteria for 
acceptability from the previous lot of CA-125 
quality control materials revealed that the criteria | 
for acceptability for the quality control materials 
used by the laboratory on November 19, 2015 to 
monitor patient CA-125 testing did not match the | 
criteria for acceptability from the previous lot of 
CA-125 quality control materials. 
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e. Upon further review, it was discovered that | 
the criteria for acceptability for the quality control 
materials used by the laboratory on November 
19, 2015 to monitor patient CA-125 testing was 
the criteria for acceptability established by the 
manufacturer for Bio-Rad, lot number 19980, for 
use on a different instrument and not the 
Siemens Advia Centaur XP Immunoassay 
System instrument. 


f. From the date quality control materials 
Bio-Rad, lot number 19980 to November 19, 
2015, the laboratory performed and reported 46 
patient CA-125 tests. 


7. Based on laboratory personnel interviews and 

the laboratory's "Alternative Assessment 

Program" (AAP) record review on Novernber 20, 

2015, the laboratory failed to have an analytic 

systems quality assessment mechanism that 

included the timely review of the effectiveness of 
actions taken. Findings included: 


a. Tocomply with the CLiA requirement at 42 

| C.F.R. 493.1281(a), the laboratory maintained a 
| protocol titled "Proficiency Testing for Theranos 
| Lab-Developed Tests" that included a laboratory 
process called AAP in which tests performed 
using the Advia 1800 would be evaluated and 
defined in relationship to the Advia XPT. 


b. Areview of laboratory documents indicated 
that for the following AAP events, the laboratory's | 
evaluation was not timely and, therefore, 
ineffective: 


i. OnApril 1, 2014, the laboratory completed | 
testing for 18 routine chemistry analytes using the | 
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Advia 1800 and compared these test results to 

' test results on the same samples using the Advia 

| XPT. Laboratory records indicated that the 

review of this AAP was not completed until 

: November 16, 2015 by appropriate laboratory 

| personnel and was not reviewed by the laboratory 
director as required by laboratory protocol. 


ili. On May 15, 2014, the laboratory completed | 
testing for 14 routine chemistry analytes using the | 
| Advia 1800 and compared these test results to 
test results on the same samples using the Advia | 
XPT. Laboratory records indicated that the | 
review of this AAP was not completed until 
November 15, 2015 by appropriate laboratory 
personnel. 


iii, On July 31, 2074, the laboratory completed 
testing for 18 routine chemistry analytes using the 
Advia 1800 and compared these test results to 
fest results on the same samples using the Advia 
XPT. Laboratory records indicated that the 
review of this AAP was not completed until 
November 16, 2015 by appropriate laboratory 
personnel and was not reviewed by the laboratory 
director as required by laboratory protocol. 


iv. On November 20, 2014, the laboratory 
completed testing for 14 routine chemistry 
analytes using the Advia 1800 and compared 

| these test results to test results on the same 

| samples using the Advia XPT. Laboratory 
records indicated that the review of this AAP was 
' not completed until November 15, 2015 by 

| appropriate laboratory personnel. 


| 8. Based on review of the quality control (QC) 
procedure, Levey-Jennings reports for the Advia 
, 1800 and Advia XPT, proficiency testing (PT) 
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| results and quality assessment (QA) 

, documentation the laboratory failed to take 

corrective actions when chemistry QC in the 

venipuncture laboratory was observed ten 

| consecutive times on the same side of the mean. 
Findings include: 


a, CL QOP-00013 Revision D, "Quality Control 
in Chemistry", stated in section 6.3.1.7.2 that QC 
is deemed to have passed when... Wesigard rules 
hae not been violated (see following monthly QC 
section 6.3.2)." 


b. CL QOP-00013 Revision D also stated in 
section 6.3.2.5 that ten consecutive observations 
on the same side of the mean should be 
monitored. 


c. The Advia XPT was put into use for chemistry 
testing on 12/18/14. Prior to 12/18/14, the Advia 
1800 was used for chemistry testing. 


Albumin 


i. Review of the PT results for alburnin for the 
ist and 2nd events of 2015 revealed that the 

| submitted results showed a negative bias ranging 
from -3.3 to -4.9 and -1.8 to -3.5, respectively. 


| ii. Review of Levey-Jenning reports from April 

2014 and September 2014, revealed that 

| MultiQual Level 1 (MQ1) and Muiti Qual Level 2 

| (MQ2) had at least 10 consecutive results below 
the mean but within 2 standard deviations (SD). 


iii. Review of Levey-Jenning reports for January 
2015 through April 2015 revealed MQ1 (Lot 
number 45661) had 10 consecutive results below 
the mean, MQ2 (Lot number 45662) had 10 
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| consecutive results below the mean and 
MultiQual Level3 (MQ3, Lot number 45663) had 

| 10 consecutive results below the mean but within 
| 2 SDs for all four months. 


iv. MQ1 data revealed 125 of 125 below the 
| mean for January 2015 through April 2015 but 
within 2 SDs. 


|v. MQ2 data revealed 126 of 126 below the 
) mean for January 2015 through April 2015 but 
i within 2 SDs. 


'vi. MQ3 data revealed 123 of 125 below the 
| mean for January 2015 through April 2015 but 
within 2 SDs. 


vil. Review of Levey-Jenning reports from May 
| 2015 revealed that MQ1, MQ2 and MQ3 were 
below the mean for 21 of 31 days. 


_ Vili. The mean for all three levels was adjusted on | 
5/22/15 to fit the data without investigation or 
documentation of an investigation. After 5/22/15 | 
all 3 levels of QC were above the mean. 


ix. The manufacturer ranges for MQ1 (Lot 
number 45661) was 2.03-3.04 g/dL; MQ2 (Lot 
number 45662) was 3.04-4.56 g/dL; MQ3 (Lot 
number 45663) was 3.26-4.89 g/dL. 


x. After adjusting the acceptable ranges on 
§/22/15, the laboratory's ranges fell outside the 
manufacturer's assayed ranges and were as 
follows: MQ1 (1.77-2.665 g/dL); MQ2 (2.5-3.74 
g/dL; MQ3 (3.02-4.52 g/dL). 


xi. Quarterly Quality Assessment PowerPoint 
presentations from the 3rd quarter of 2014 
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| through the 2nd quarter of 2015 did not identify 
the negative bias for albumin or the 10 
consecutive QC values above or below the mean. 


{ 
i 


xii. 8293 albumins were reported from January 
2015 through June 2015. 


Calcium 


i. Review of the PT results for calcium for the 
2nd events of 2015 revealed that the submitted | 
results showed a negative bias ranging from -3.9 | 
to -5.1. 


ii. Review of Levey-Jenning reports from April 
2014 and May 2015 revealed 27 of 27 and 25 of 
25 QC consecutive results below the mean but 
within 2 SDs. 


iii. 7719 calciums were reported from January 
2015 through June 2015. 


Other Chemistries 


Review of Levey-Jenning reports from April 2074, 

September 2014, and January 2014 revealed that 

Creatinine, Glucose, High density lipoprotein 

(HDL), Low density lipoprotein (LDL), Total 

| Bilirubin, Chloride, Potassium, Triglycerides, 

Cholesterol, Alkaline Phosphatase, and Alanine 
Transaminase had at least one event of 10 

| consecutive QC results above or below the mean 
but within 2 SDs for one to 3 levels of QC. 


9. Based on review of the alternative 
| assessment procedure (AAP) and results of AAP 
from August 2014 through March 2015, the 
| laboratory failed to identify through the quality 
; assessment (QA) activities that the AAP for the 
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Theranos Propietary System (TPS) was not 
performed every 6 months and was not reviewed 
and reviewed and approved by the laboratory 
(LD) in a timely manner as required by the 
laboratory's procedures, and therefore, 
ineffective. Findings include: 


a. CL SOP-00020 Revision B, "Proficiency 
testing for Theranos Lab-Developed Tests 
(Immunoassays)", effective 1/1/2014, stated in 
section 3.1 that the technical supervisor (TS) was 
responsible for ensuring that the AAP was 
conducted every 6 months for all analytes. 


b. Section 3.3.2 of the procedures stated that 
the TS was reponsible for evaluating testing 
samples results and section 3.4 stated that the 
LD was responsible for reviewing and approving 
each testing event documentation. 


c. Review of the AAP result forms (CL 
FRM-00022-F3) revealed that the AAP was 
performed on 8/18/14, 10/21/14, and 3/13/15. 


d. All three result forms did not include a 
documented evaluation by the TS. 


e. The result documents from 8/18/14 and 
3/15/15 were not signed by the LD until 11/15/15 
and the result form from 10/12/14 was not signed 
by the LD. 


f. Four tests (Vitamin D, Thyroid Stimulating 
Hormone, Free T4, and Total Prostate Specific 
Antigen) were initially implemented in November 
2013. 


10. Based on review of patient raw data reporis 
and the validation report for Vitamin D (VitD), the 
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laboratory failed to have a quality assessement 
mechanism to identify that the laboratory's 
reference ranges established from the validation 
study were accurately reflected on the patient raw 
data reports. Findings include: 


a. The validation report for VitD stated that the 
reference range was 9.3-47.9 ng/mL. 


b. The patient raw data reports revealed that the 
reference range was "30-100." 


_c. Patient raw data reports were reviewed from 
| 6/15/14 through 8/31/14 and from 2/1/15 through 
2/17/18. 


'd. Thirty (30) of ninety-four (94) patient results 

were flagged as "Insufficiency" on the patient raw 

data report when the result was normal according 
to the laboratory's reference range. 


e. Twenty seven (27) of ninety four (94) patient 
results were flagged as normal on the patient raw 
data report when the result was above the normal 
range according to the laboratory's reference 
range. 

493.1291{a) TEST REPORT 


The laboratory must have an adequate manual or | 
electronic system(s) in place to ensure test 

results and other patient-specific data are 
accurately and reliably sent from the point of data 
entry (whether interfaced or entered manually) to | 
final report destination, in a timely manner. This 
includes the following: 

(a)(1) Results reported from calculated data. 
(a)(2) Results and patient-specific data 
electronically reported to network or interfaced 
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systems. 

(a)(3} Manually transcribed or electronically 
transmitted results and patient-specific 
information reported directly or upon receipt from 
outside referral laboratories, satellite or | 
point-of-care testing locations. | 
This STANDARD is not met as evidenced by: 
Based on review of the patient results, 
manufacturer International Sensitivity Index (ISI) | 
number, and the jaboratory's mean normal 
prothrombin time (MNPT), the laboratory failed to 
ensure that the reported International Normalized 
Ratio (INR) was calculated accurately prior to 
reporting final patient test results. Findings 
include: 


a. Laboratory quality control records revealed 
that Dade Innovin (thromboplastin) lot number 

| 539280 was put into use in March 2015. The 
MNPT for this lot number was determined to be 
8.0 seconds and the manufacturer stated that the 
iS] was 0.89. 


|b. Areview of the INR results from 4/3/15 
through 9/21/15 revealed that 81 of 81 reported 
final patient results were not accurate when the 
_ patient prothrombin time (PT) was used with the 
above MNPT and ISI numbers to calculate the 
INR. 


'c. The final reported results varied from the true 
| results by 0.1-0.5 units. 
493.1291(c) TEST REPORT 


The test report must indicate the following: 

| (c)(1) For positive patient identification, either the 
patient's name and identification number, or a 
unique patient identifier and identification number. 
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(c)(2) The name and address of the laboratory 
location where the test was performed. 

(c)(3) The test report date. 

(c)(4) The test performed. 

(c)(5) Specimen source, when appropriate. 
(c)(6) The test result and, if applicable, the units 
of measurement or interpretation, or both. 

(c)(7) Any information regarding the condition and 
disposition of specimens that do not meet the 
laboratory's criteria for acceptability. 

This STANDARD is not met as evidenced by: 
Based on review of final reports and interview 


‘ with the Senior Vice President, the laboratory 


failed to differentiate the intrepretive data for 
Warfarin therapy vs. Non-Warfarin Therapy. 


| Findings include. 


a. Thirteen of thirteen final patient test reports 
| reviewed indicated that the International 
| Normalized Ratio (INR) interpretive data on the 
final report was identical for Warfarin therapy and 
non-Warfarin therapy. 


b. The Senior Vice President confirmed the 
above finding on 9/22/15 at approximately 4:45 
pm. 

493.1291(k) TEST REPORT 


When errors in the reported patient test results 
are detected, the laboratory must do the 
following: 

(k)(1) Promptly notify the authorized person 
ordering the test and, if applicable, the individual 
using the test results of reporting errors. 

(k)(2} Issue corrected reports promptly to the 
authorized person ordering the test and, if 
applicable, the individual using the test results. 
(k)(3) Maintain duplicates of the original report, as 
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well as the corrected report. i 
This STANDARD is not met as evidenced by: 
Based on review of patient test reports and 
interview with the technical supervisor, the 
laboratory failed to notify the authorized person 
for approximately seven weeks after the surveyor | / 
identified a quality control problem with 
Prothrombin Time/international Normalized Ratio | 
(PT/INR). Findings include: 


a. Refer to D6093. 


b. Five of thirteen final patient reports reviewed 
showed corrected reports were faxed between 
11/11/15 and 11/15/15. 


c. Eight of thirteen final patient reports reviewed 
did not show documentation that the authroized 
person was notified when an error in patient test 
results was detected. 


d. 81 PT/INR patient test results were reported 
| from 4/1/15 through 9/16/15. 


e. The technical supervisor stated that all 

| authorized persons were notified of the error in 
| PTANR results, including those without 
documentation. 

493.1441 LABORATORY DIRECTOR 


The laboratory must have a director who meets 
the qualification requirements of §493.1443 of 
this subpart and provides overall management 
and direction in accordance with §493.1445 of 
this subpart. 


This CONDITION is not met as evidenced by: 
Based on the number and severity of the 
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deficiencies cited herein, the Condition: 
Laboratories performing high complexity testing; 
laboratory director was not met. The laboratory 
director failed to ensure that appropriate 
personnel were responsible for the quality control 
(QC) and quality assessment (QA) programs (see 
D6078): failed to ensure that the freezer 
temperatures were appropriate for storage of 
specimens and reference maierials (see D6083); 
failed to ensure the methodologies selected 
provided quality results (see D6085): failed to 
ensure the verification procedures were adequate 
(see D60886): failed to ensure that the QC 

| programs (see D6093) and QA programs (see 
D6094) are established and maintained; failed to 
ensure that the final patient test reports included 
appropriate interpretation information for PT/INR 
(see D6098); and failed to ensure that all 

| personnel were appropriately trained (see 

| D6102). 

493.1445(a)(b) LABORATORY DIRECTOR 
RESPONSIBILITIES 


The laboratory director is responsible for the 

i overall operation and administration of the 
laboratory, including the empioyment of personnel 
who are competent to perform test procedures, 
record and report test results promptly, accurately 
and proficiently, and for assuring compliance with 
the applicable regulations. 
(a) The laboratory director, if qualified, may 
perform the duties of the technical supervisor, 
clinical consultant, general supervisor, and testing 
personnel, or delegate these responsibilities to 
personnel meeting the qualifications under 
493.1447, 493.1453, 493.1459, and 493.1487 
respectively. 

(b) If the laboratory director reapportions 
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| performance of his or her responsibilities, he or 
she remains responsible for ensuring that all 
duties are properly performed. 

| This STANDARD is not met as evidenced by: 
Based on the Plan of Correction (POC) from the 
12/3/2013 recertification survey and review of 

| quality control (QC) and quality assessment (QA) 
| documentation and the Laboratory Personnel 
Report (CMS-209), the laboratory director (LD) 
failed to ensure that the laboratory's QC and QA 
programs were delegated to a qualified technical 
supervisor (TS). Findings include: 


/@. The POC from the laboratory's 12/3/2013 

| recertification survey stated that a QA/QC 

Manager was hired and began employment on 
42/10/13. 


b. The QA/QC Manager stated on 9/23/15 and 
again on 11/19/15 that evaluating and monitoring 
the QA and QC programs was solely the QA/QC 
Manager's responsibility. 


c. The QA/QC Manager was not listed on the 
CMS-209 forms dated 9/19/15, 9/23/15, or 
11/15/15 in any capacity. 


d. The QA/QC Manager was not qualified to 
oversee and maintain the QC and QA programs. 
493.1445(e)(2) LABORATORY DIRECTOR 
RESPONSIBILITIES 


The laboratory director must ensure that the 
physical plant and environmental conditions of the 
laboratory are appropriate for the testing 
performed. 

This STANDARD is not met as evidenced by: 
Based on review of temperature documentation 
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corrected or which result was reported. 


SUMMARY STATEMENT OF DEFICIENCIES 
(EACH DEFICIENCY MUST BE PRECEDED BY FULL 
REGULATORY OR LSC IDENTIFYING INFORMATION} 


Continued From page 74 


and interview with the Director of Assay Systems, 
the laboratory director failed to ensure that the 
freezer temperatures were appropriate for 
storage of reference materials and patient 
specimens. Refer to D5413 and D5791. 
493.1445(e)(3) LABORATORY DIRECTOR 
RESPONSIBILITIES 


The laboratory director must ensure that the test 
methodologies selected have the capability of 
providing the quality of results required for patient 
care. 
This STANDARD is not met as evidenced by: | 
Based on review of validation documents on the | 
Theranos Proprietary System (TPS), the 
laboratory director failed to ensure that the quality 
of results on the TPS; failed to ensure the | 
establishment of performance specifications 
followed the laboratory's procedures to establish 
accuracy, precision, reportable range, and/or 
reference range. Findings include: | 
a. Validations Reports for Vitamin D (VitD), Total | 
T3 (TT3), Human Chorionic Gonadotropin (HCG), 
and Sex Hormone Binding Globulin (SHBG) were 
reviewed. 


b. The laboratory presented the procedure, CL 
PLN-14003 Revision A, "Master Validation Plan 
for Routine Chemistry Assays on Theranos 
Devices", when the surveyor requested their 
procedure for establishing performance 
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d. Accuracy for VitD, TT3, HCG, and SHBG was 
| not determined following CL PLN-14003. 


6. Precision for VitD, TT3, and SHBG was not 
determined following CL PLN-14003. 


f. Reportable range data for VitD, TT3, and 
SHBG was not determined following CL 
PLN-14003. 


g. Percent (%) Recovery did not meet the 
laboratory's accetable criteria for VitD, TT3, and 
SHBG. 


h. Allowable Bias did not meet the laboratory's 
acceptabie criteria for VitD, TT3, and SHBG. 


i. Refer to D6115. 
493.1445(e)(3)(il) LABORATORY DIRECTOR 
RESPONSIBILITIES 


The laboratory director must ensure that 
verification procedures used are adequate to 
determine the accuracy, precision, and other 
pertinent performance characteristics of the 

| method. 

| This STANDARD is not met as evidenced by: 

1. Based on laboratory personnel interview and 
| establishment of vitamin B12 performance 

| specifications record review on September 22, 
2015, the laboratory director failed to ensure that 
| verification procedures used were adequate to 

| determine pertinent performance characteristics 
| for the laboratory's vitamin B12 testing methods. 
| Findings included: 


a. Areview of the laboratory's vitamin B12 
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establishment of performance specifications 
document indicated that the laboratory obtained 
an allowable bias greater than the laboratory's 
criteria for acceptability. When asked to explain 
this discrepant result, upon close examination, | 
laboratory personnel indicated that there was an | 
error in the written information provided and 
reviewed. The laboratory was able to provided 
corrected data and appropriate supporting 
documents. 


b. In spite of the erroneous information included 
in the vitamin B12 establishment of performance 
specifications document provided during this 
survey for review on September 22, 2015, 
laboratory records indicated that eleven people 
from the laboratory's staff approved this 
document between August 5, 2014 and 
September 19, 2015 without recognizing the 
document error. 


2. Based on laboratory personnel interviews and : 
establishment of performance specifications 
policies and procedures record review on 
September 22, 2015, the laboratory director failed | 
to ensure that verification procedures used are 

adequate to determine the accuracy, precision, 

and other pertinent performance characteristics 
of the laboratory's Advia 1800 testing methods. 

Findings included: 


| a. It was the practice of the laboratory to use the 
| Siemens Advia 1800 to perform and report patient 
i routine chemistry serum testing. Examples of 
analytes the laboratory tested using the Advia 
1800 included ALT, BUN, calcium, glucose, and 
sodium. 


| b. According to the laboratory's protocol titled 
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| “Master Validation Plan for Routine Chemistry 

| Assays on Theranos Devices," "for establishing 
the trueness or comparability of two procedures. . 
.at least 50% of samples should be outside the 
reference interval." 


c. Areview of the test resulis used by the 
| laboratory to establish “the trueness or 
i comparability of two procedures" for ALT, BUN, 
| calcium, glucose, and sodium testing using the 
| Advia 1800 showed that the laboratory did not 
| follow its established protocol and use "at least 
50% of samples. . outside the reference interval." 


i. Fora validation document dated April 2, 
2015, ALT test results used to establish "the 
trueness or comparability of two procedures" for 
tests performed using the Advia 1800, 6 of 110 
_ALT test results used were outside the 

| laboratory's reference interval. 


ii, Fora validation document dated April 21, 
2015, BUN test results used to establish "the 
frueness or comparability of two procedures" for 

' tests performed using the Advia 1800, 1 of 109 

| BUN test result used was outside the laboratory's 
reference interval. 


iii. Fora validation document dated April 21, 
2015, calcium test results used to establish "the | 
trueness or comparability of two procedures" for 
tests performed using the Advia 1800, 1 of 110 
calcium test result used was outside the 
laboratory's reference interval. 


iv. For a validation document dated April 21, 
2015, glucose test results used to establish “the 
trueness or comparability of two procedures" for 
tests performed using the Advia 1800,60f 110 | 
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glucose test results used were outside the 
laboratory's reference interval. 


v. Fora validation dacument dated April 1, 
2015, sodium test results used to establish “the 
trueness or comparability of two procedures" for 
tests performed using the Advia 1800, 1 of 113 
sodium test result used was outside the 
laboratory's reference interval. 


H 
3. Based on laboratory personnel interviews and 
establishment of performance specifications 
record review on November 17, 2015, the | 
laboratory director failed to ensure that ALT, BUN, | 
calcium, glucose, and sodium verification 
procedures used were adequate to determine the 
precision of the laboratory's Advia 1800 testing 
methods. Findings included: 


a. It was the practice of the laboratory to use the 
Siemens Advia 1800 to perform and report patient 
routine chemistry serum testing. Examples of 
analytes the laboratory tested using the Advia 
1800 included ALT, BUN, calcium, glucose, and 
sodium. 


b. Areview of laboratory documents 
establishing performance specifications for ALT, 
BUN, calcium, glucose, and sodiurn performed 
using the Advia 1800 indicated that the coefficient 
of variation (CV) determined by the laboratory's 
testing differed from the CV established by the 
manufacturer. 


i. ForALT, based on a laboratory document 
dated April 2, 2015, the laboratory determined 
ALT Advia 1800 CV's between 2.0 - 5.5. The 
manufacturer's established ALT CV's were 
between 1.6 - 3.1. 
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ii. For BUN, based on a laboratory document 
dated April 21, 2015, the laboratory determined 
BUN Advia 1800 CV's between 2.1 - 2.7. The 
manufacturer's established BUN CV's were 
between 1.7 - 2.4. 

iii. For calcium, based on a laboratory document 
dated April 21, 2015, the laboratory determined 
calcium Advia 1800 CV's between 2.0 - 3.6. The 
manufacturer's established calcium CV's were | 
between 0.8 - 2.1. 


iv. For glucose, based on a laboratory document | 
dated April 21, 2015, the laboratory determined 
glucose Advia 1800 CV's between 1.5-2.2. The 
manufacturer's established glucose CV's were 
between 0.7 - 0.9. 


v. For sodium, based on a laboratory document 
| dated April 1, 2015, the laboratory determined | 
sodium Advia 1800 CV's between 1.2- 1.3. The | 
manufacturer's established sodium CV's were _ 
| between 0.6 - 1.1. 


c. The laboratory provided no written 

| explanation/investigation as to why the laboratory 
obtained CV's for ALT, BUN, calcium, glucose, 
and sodium using the Advia 1800 that were 

| greater than the CV's established by the 
manufacturer. Laboratory records indicated that 
these laboratory documents were approved by 

| the laboratory director on September 19, 2015. 


4. Based on laboratory personnel interviews and 
establishment of performance specifications 

| record review on November 17, 2015, the 
laboratory director failed to ensure that ALT, BUN, 
calcium, and glucose verification procedures 
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used were adequate to determine pertinent 
performance characteristics, such as reference 
range, of the laboratory's Advia 1800 testing 
methods. Findings included: 


a. lt was the practice of the laboratory to use the | 
Siemens Advia 1800 to perform and report patient | 
routine chemistry serum testing. Examples of 
analytes the laboratory tested using the Advia 
1800 included ALT, BUN, calcium, and glucose. 


b, Areview of laboratory documents 
establishing performance specifications for ALT, 
BUN, calcium, and glucose performed using the 
Advia 1800 indicated that the reference range 
determined by the laboratory's testing differed 
from the reference range on the laboratory's test 
reports. 


i. ForAtLT, based on a laboratory document 
dated April 2, 2015, the laboratory determined the 
ALT Advia 1800 reference range as 0 - 52 U/L. 
However, the laboratory's reference range on the 
test reports was 8 - 41 U/L. 


ii. For BUN, based on a jaboratory document 
dated April 21, 2015, the laboratory determined 
the BUN Advia 1800 reference range as 5.3 - 
22.5 mg/dL. However, the laboratory's reference 
range on the test reports was 6 - 24 mg/dL. 


iii, For calcium, based on a laboratory document 
dated April 21, 2015, the laboratory determined 
the calcium Advia 1800 reference range as 8.18 - 
10.3 mg/dL. However, the laboratory's reference 
range on the test reports was 8.3 - 10.6 mg/dL. 


iv. For glucose, based on a laboratory document 
dated April 21, 2015, the laboratory determined 
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the glucose Advia 1800 reference range as 64.0 - 
112.3 mg/dL. However, the laboratory's 
reference range on the test reports was 73 - 99 
mg/dL. 


c. The laboratory provided no written 
explanation/investigation as to why the laboratory | 
obtained reference ranges for ALT, BUN, calcium, 
and glucose were different than than the 
reference ranges indicated on the test reports.. 
Laboratory records indicated that these laboratory | 
documents were approved by the laboratory | 
director on September 19, 2015. 


5. Based on laboratory personnel interviews and 
complete blood counts (CBC) verification of 
method specifications record review on 
November 19, 2075, the laboratory director failed 
to ensure that verification procedures used were 
adequate to determine the accuracy, precision, 
and other pertinent performance characteristics 
for the two Siemens Advia 2120 instruments. 
Findings included: 


a. It was the practice of the laboratory to test 
patient venous CBC specimens using two 
Siemens Advia 2120i instruments, designated as 
#1 and #2. 


|b. Although the laboratory maintained 

verification of test performance specifications 

| documents for the two Advia 2120i instruments, 

the laboratory maintained no documentation to 

| indicate that verification results for the two 

instruments were acceptable to the laboratory, no 

| evidence that the laboratory director had 

| reviewed and approved the verification 
documents, and no date the verification 

| documents were reviewed and approved. 
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1c. Between February 2015 and September 21, 

2015, the laboratory performed and reported 

| 2,395 patient CBC test results using the Advia 

21201 #1. From November 6, 2015 to November 

(19, 2015, the laboratory performed and reported 

i 67 patient CBC test results using the Advia 21201 
#2. 


6. Based on review of documentation, lack of 
documentation, observation and interview with 
the general supervisor, the laboratory director 
failed to ensure that the laboratory determined 
the mean normal prothrombin time (MNPT) prior 
to implementing a new lot number of Innovin 
(thromboplastin) on the Siemens BCS XP. 
Findings include: 


a. Dade Innovin (thromboplastin) jot number 
539280 was put into use in March 2015. 


b. The test system required that the MNPT (in 
seconds) be calculated for each new lot number | 
of Innovin. 


c. The MNPT specific to the lot number of 
innovin was to be entered into the BCS XP. 


d. The MNPT was observed on 9/23/15 at 
| approximately 3:25 pm revealed the correct 
MNPT was entered into the BCS XP. 


e. Review of the MNPT data revealed that the 
| MNPT data was performed on 9/18/15. 


_f. The general supervisor stated that there 
should be date from March 20715; however, the 
| documentation could not be located. | 
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493.1445(e)(5) LABORATORY DIRECTOR 
RESPONSIBILITIES 


The laboratory director must ensure that the 
quality control programs are established and 
maintained to assure the quality of laboratory 
services provided and to identify failures in quality 
| as they occur. 

This STANDARD is not met as evidenced by: 

1. Based on laboratory personnel interviews, 
direct observations, and quality control document 
reviews, the laboratory director failed to ensure 
| that quality control programs were established 
| and maintained to assure the quality of laboratory 
services provided and to identify failures in quality 
‘as they occur. The laboratory director failed to 
ensure that the laboratory included two quality 
control materials at least once each day patient 
| specimens were examined (see D5447), the 
laboratory included a positive control material at 
' least once each day patient specimens were 
| assayed (see D5449), stated values of 
| commercially assayed quality contro! materials 
| were verified (see D5469), each batch of media 
was checked for its ability to support growth (see 
| 05477), results of quality control materials met 
the laboratory's criteria for acceptability (see 
| 95481}, and the laboratory followed established 
quality control corrective action protocols (see 
| D5779). 


2. Based on review of the prothrombin 

' time/international normalized ratio (PT/INR) 
procedure, quality control (QC) records and 
| interview with the general supervisor, the 


PT/INR was acceptable prior to reporting patient 
| results and failed to identify that the QC data 
revealed a shift greater than 2 standard 
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deviations (SD) from April 2015 through 
September 2015. Findings include: 


a. CL SOP-10001 Revision A, "Measuring 
Prothrombin Time-innovin (PT on the Siemens 
BCS XP Instrument" stated on page 6, section 
8.6 that if control values are outside of the 
determined range, the controls, reagents and 
instrument performance should be checked and 
that identification and correction of the problem 
shoud be documented prior to reporting patient 
results. 


b. QC records for Citrol 3 (Lot number 548425) 
were reviewed from 4/1/15 through 9/23/15. 


c. The general supervisor stated that QC was 
acceptable if the values were +/- 2 SD from the 
mean. 


d. FromApril 1, 2015 through September 16, 
2015, 32 of 69 days showed Citrol3 QC values | 
were greater than 2 SD (- 2 SD) below the mean. | 


e. On 4/7/15, Citrol 3 was run six times before 
an acceptable QC value was obtained. 


f. On 9/7/15, Citrol 3 was run seven times 
without obtaining an acceptable QC value. 


g. On 9/8/15, Citrol 3 was run twelve times 
| without obtaining an acceptable QC value. 


h. On 25 of 32 days, Citrol 3 was not retrun 
, when the QC value was greater than - 2 SD. 


fi. = On 5/15/15, 8/13/15, 8/21/15 and 9/10/15, 
| Citrol 3 was run twice. All QC results were 
| unacceptable. 
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ij. TheRule Check report revealed that 13 of 13 
QC values in April 2015, 2 of 17 in May 2015, 7 of 
7 in June 2015; 13 of 13 in July 2015, 16 of 16 in 

| August and 24 of 24 9/1-9/16 2015 showed rule 

| violation messages related to Citrol 3. 


k. On approximately 9/16/15, the labortory 

| adjusted the acceptable range for Citrol 3 to 
match the data. This change was implemented 
without any investigation as to the reason for the 
| shift in control values. 


|. 81 patients were reported from 4/1/15 

| through 9/16/15. 

| 493,1445(e)(5) LABORATORY DIRECTOR 
RESPONSIBILITIES 


|The laboratory director must ensure that the 
quality assessment programs are established and 
maintained to assure the quality of laboratory 

| services provided and to identify failures in quality 
| as they occur. 

This STANDARD is not met as evidenced by: 

| 1. Based on laboratory personnel interviews, 
direct observations, and quality control document 
reviews, the laboratory director failed to ensure 
that quality assessment programs were 
established and maintained to assure the quality 
of laboratory services provided and to identify 
failures in quality as they occur. The laboratory 
director failed to ensure that preanalytic (see 
D5391 and D5393) and analytic (see D5791 and 
D5793) systems quality assessment programs 
were established, followed, and effective. | 


2. Based on review of documentation and lack 
of documentation, the laboratory director failed to | 
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identify failures in Prothrombin Time/International 
Normalized Ratio (PT/INR) testing which affected | 


| the quality of the PT/INR patient resuits. Findings | 
_ include: 


a. The Dada Innovin (thromboplastin) reagent 
| was used past the expiration date. Refer to 
D5413. 


b. The quality control data from 4/1/2015 

| through 9/16/15 revealed that patient results 
above normal were biased low (i.e., reported 
value was lower than it should have been 

| reported). 


c. The target INR value for patients on Warfarin | 
therapy was 2-3. 


d. 81 patients were reported from 4/1/15 
through 9/21/15. 


e. 44 of 81 patients had INRs greater than or 
equal to 2 reported and of the 44, 16 of the 44 
had INR greater than or equal to 3 reported. 


f. There was no quality assessment (QA) or 
other documentation to indicate that the PT/INR 
failure had been identified and corrected. 
493.1445(e)(8) LABORATORY DIRECTOR 
RESPONSIBILITIES 


The laboratory director must ensure that reports 
of test results include pertinent information 
required for interpretation. 

This STANDARD is not met as evidenced by: 
Based on review of final test reports and 
interview with the Senior Vice President, the 
laboratory director failed to ensure that the 
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interpretive data on the Prothrombin 
Time/international Normalized Ratio (PT/INR) 
final reports was clear to differentiate between 
Warfarin therapy and non-Warfarin therapy. 
Refer to D5805. 

493.1445(e)(12) LABORATORY DIRECTOR 
RESPONSIBILITIES 


The laboratory director must ensure that prior to 
| testing patients’ specimens, all personnel have 
the appropriate education and experience, 
receive the appropriate training for the type and 
| complexity of the services offered, and have 
demonstrated that they can perform all testing 

| operations reliably to provide and report accurate 
| results. 

This STANDARD is not met as evidenced by: 

| Based on review of training documents and 

| interview with the QA/QC (Quality 
Assurance/Quality Control) Manager, technical 

| Supervisor and testing personnel, the laboratory 
failed to document training of testing personnel 
on the Theranos Proprietary System (TPS) prior 
to patient testing and failed to document training 
in the vacutainer laboratory of testing personnel 
prior to patient testing. Findings include: 


a. Theranos Proprietary System (TSP) 

i. The QA/QC Manager and technical 
supervisor stated that all training documentation 
was kept in each testing person's employee file. 
ii, Eleven testing personnel files were reviewed. 
iii. Eight of eleven personnel files did not include 


any documentation of training on the TPS prior to 
_Tunning and reporting patient test results. 
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b. Venipuncture Laboratory 


a. The QA/QC Manager and technical 
supervisor stated that all training documentation 
was kept in each testing person's employee file. 


b. Three testing personnel files were reviewed. 


c. Testing Person #6 (TP6) training records did 
not include documentation for the Siemens XPT, 
Advia 2120], Eldon Card, and were incomplete for 
the Centaur, IRIS, BC SXP and Cellavision. 


d. TP6 stated that training had not been 
completed as of 9/23/15; however PT6 had been 
running and reporting patient test results since 
April 2015. TP6 also stated that activities listed 
on the training documentation which were not 
signed off were performed by TP6, but training 
had not occurred. 


e. TP6 confirmed the above findings on 9/23/15 
| at approximately 3:30 pm. 


if. Testing Person #11 (TP11) training records | 
did not include documentation for the Advia, 
'Immulite, BC SXP, Advia 2120i, Centaur, 
MacroVu RPR, Multispot HIV, and Diasorin 

| Liaison. 


|g. TP6 stated that TP11 ran and reported 
patient test results from these systems. 


h. Testing Person #37 (TP31)'s training 
| documentation included documents on critical 
| values and critical values logsheets. No other 
| training documentation was found. 


FORM CMS-2567(02-99) Previous Versions Obsolete Event 1D: W34211 Facility ID: CA22046272 lf continuation sheet Page 89 of 127 


FOIA Confidential Treatment Requested by Theranos TS-0917975 
Trial Exh. 4621 Page 0093 ER-5550 


Case: 22-10338, 05/04/2023, ID: 12709436, DktEntry: 22-21, Page 157 of 188 


PRINTED: 01/25/2016 
DEPARTMENT OF HEALTH AND HUMAN SERVICES FORM APPROVED 


CENTERS FOR MEDICARE & MEDICAID SERVICES OMB NO. 0938-0391 


STATEMENT OF DEFICIENCIES (X1) PROVIDER/SUPPLIER/CLIA (X2) MULTIPLE CONSTRUCTION (X3) DATE SURVEY 
AND PLAN OF CORRECTION IDENTIFICATION NUMBER: A. BUILDING COMPLETED 


05D2025714 B, WING 11/20/2015 
NAME OF PROVIDER OR SUPPLIER STREET ADDRESS, CITY, STATE, ZIP CODE 
7333 GATEWAY BLVD 
NEWARK, CA 94560 


THERANOS INC 


(X4) ID SUMMARY STATEMENT OF DEFICIENCIES PROVIDER'S PLAN OF CORRECTION (X5) 
PREFIX (EACH DEFICIENCY MUST BE PRECEDED BY FULL (EACH CORRECTIVE ACTION SHOULD BE | COMPLETION 

TAG | REGULATORY OR LSC IDENTIFYING INFORMATION) CROSS-REFERENCED TO THE APPROPRIATE DATE 
DEFICIENCY) 


Continued From page 89 


i. The general supervisor stated that TP31 had 
been running and releasing patient test results. 


j. The general supervisor confirmed that the 
training documents were missing or incomplete 
for three of three testing personnel on 11/19/15 at 
11:40 am. 

493.1447 LABORATORY TECHNICAL 
SUPERVISOR 


The laboratory must have a technical supervisor 
who meets the qualification requirements of 
§493.1449 of this subpart and provides technical 
supervision in accordance with §493.1451 of this 
subpart. 


This CONDITION is not met as evidenced by: 
Based on the number and severity of the 
deficiencies cited herein, the Condition: 
Laboratories performing high complexity testing; 
technical supervisor was not met. Two of three 
technical supervisors failed to meet the training or 
experience requirement in one or more 
specialties/subspecialties (see D6111), and the 
technical supervisors failed to ensure the 
establishment of performance specifications for 
the Theranos Proprietary System (TPS) were 
complete and followed the laboratory's procedure 
(see D6115). 

493.1449 TECHNICAL SUPERVISOR 
QUALIFICATIONS 


(a) The technical supervisor must possess a 
current license issued by the State in which the 
laboratory is located, if such licensing is required: 
and 

(b) The laboratory may perform anatomic and 
clinical laboratory procedures and tests in alll 
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specialties and subspecialties of services except | 
histocompatibility and clinical cytogenetics 
services provided the individual functioning as the 
technical supervisor-- 
(b}(1) ls a doctor of medicine or doctor of 
osteopathy licensed to practice medicine or 
osteopathy in the State in which the laboratory is 
located; and 

(b)(2) is certified in both anatomic and clinical 
pathology by the American Board of Pathology or 
the American Osteopathic Board of Pathology or 
Possesses qualifications that are equivalent to 
those required for such certification. 

(c) lf the requirements of paragraph (b) of this 
section are not met and the laboratory performs 
tests in the subspecialty of bacteriology, the 
individual functioning as the technical supervisor 
must-- 

(c)(1){i) Be a doctor of medicine or doctor of 
osteopathy licensed to practice medicine or 
osteopathy in the State in which the laboratory is 
located; and 

(c)(1}(i) Be certified in clinical pathology by the 
American Board of Pathology or the American 
Osteopathic Board of Pathology or possess 
qualifications that are equivalent to those required 
for such certification; or 

{c)(2)(i) Be a doctor of medicine, doctor of 
osteopathy, or doctor of podiatric medicine 
licensed to practice medicine, osteopathy, or 


(c)(2)(ii) Have at least one year of laboratory 


minimum of 6 months experience in high 
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| (c)(3)(i) Have an earned doctoral degree in a 
chemical, physical, biological or clinical laboratory 
science from an accredited institution; and 

| (c)(3)(ii) Have at least 1 year of laboratory training 
or experience, or both, in high complexity testing 
within the specialty of microbiology with a 

: minimum of 6 months experience in high 

| complexity testing within the subspecialty of 
bacteriology; or 

| (c)(4)(i) Have earned a master's degree in a 

| chemical, physical, biological or clinical laboratory 
science or medical technology from an accredited 
institution; and 

| (c)(4)(ii) Have at least 2 years of laboratory 
training or experience, or both, in high complexity 
testing within the specialty of microbiology with a 
minimum of 6 months experience in high 

| complexity testing within the subspecialty of 
bacteriology; or 

(c)(5)(i) Have earned a bachelor's degree in a 
chemical, physical, or biological science or 
medical technology from an accredited institution; 
and 

(c)(5)(ii) Have at least 4 years of laboratory 


testing within the specialty of microbiology with a 
minimum of 6 months experience in high 
complexity testing within the subspecialty of 
bacteriology. 

(d) If the requirements of paragraph (b) of this 
section are not met and the laboratory performs 
tests in the subspecialty of mycobactericlogy, the 
individual functioning as the technical supervisor 
must-- 

(d)(1}(i) Be a doctor of medicine or doctor of 
osteopathy licensed to practice medicine or 
osteopathy in the State in which the laboratory is 
located; and 
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Continued From page 92 
(d)(1)(ii) Be certified in clinical pathology by the 
American Board of Pathology or the American 
Osteopathic Board of Pathology or possess 
qualifications that are equivalent to those required | 
for such certification; or 
(d)(2)(i) Be a doctor of medicine, doctor of 
osteopathy, or doctor or podiatric medicine 
licensed to practice medicine, osteopathy, or 
podiatry in the State in which the laboratory is 
located; and 
(d)(2){ii) Have at least 1 year of laboratory training 
or experience, or both, in high complexity testing 
within the specialty of microbiology with a 
minimum of 6 months experience in high 
complexity testing within the subspecialty of 
mycobacteriology; or 
(d)(3)(i) Have an earned doctoral degree in a 
chemical, physical, biological or clinical laboratory 
science from an accredited institution; and 
(d)(3)(ii) Have at least 1 year of laboratory training 
or experience, or both, in high complexity testing 
within the specialty of microbiology with a 
minimum of 6 months experience in high 
complexity testing within the subspecialty of 
mycobacteriology; or 
(d)(4)(i) Have earned a master's degree ina 
i chemical, physical, biological or clinical laboratory 
science or medical technology from an accredited 
| institution; and 
| (d)(4)(ii) Have at least 2 years of laboratory 
training or experience, or both, in high complexity 
| testing within the specialty of microbiology with a 
minimum of 6 months experience in high 
, complexity testing within the subspecialty of 
mycobacteriology; or 
' (d)(5)(i) Have earned a bachelor's degree in a 
chemical, physical or biological science or 
| medical technology from an accredited institution; 


i 
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and 

(d)(5)(ii) Have at least 4 years of laboratory 
training or experience, or both, in high complexity | 
testing within the specialty of microbiology with a 
minimum of 6 months experience in high 
complexity testing within the subspecialty of 
mycobacteriology. 

(e) If the requirements of paragraph (b) of this 
section are not met and the laboratory performs 
tests in the subspecialty of mycology, the 
individual functioning as the technical supervisor 
must-- 

(e)(1){i) Be a doctor of medicine or doctor of 
osteopathy licensed to practice medicine or 
osteopathy in the State in which the laboratory is 
located; and 

(e)(1} (ii) Be certified in clinical pathology by the 
American Board of Pathology or the American 
Osteopathic Board of Pathology or possess 
qualifications that are equivalent to those required 
for such certification; or 

(e)(2}(i) Be a doctor of medicine, doctor of 

| osteopathy, or doctor of podiatric medicine 

| licensed to practice medicine, osteopathy, or 
podiatry in the State in which the laboratory is 
located: and 

| (e)(2)(ii) Have at least 1 year of laboratory training 
or experience, or both, in high complexity testing 
within the specialty of microbiology with a 

/ minimum of 6 months experience in high 

| complexity testing within the subspecialty of 
mycology; or 

(e)(3)() Have an earned doctoral degree ina 
chemical, physical, biological or clinical laboratory | 
science from an accredited institution; and 
(e)(3){ii) Have at least 1 year of laboratory training 
or experience, or both in high complexity testing 
within the specialty of microbiology with a 
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minimum of 6 months experience in high 
complexity testing within the subspecialty of 
mycology; or 

(e)(4)(i) Have earned a master's degree ina 
chemical, physical, biological or clinical laboratory 
science or medical technology from an accredited 
institution; and 

(e)(4\(ii) Have at least 2 years of laboratory 
training or experience, or both, in high complexity 
testing within the specialty of microbiology with a 
minimum of 6 months experience in high 
complexity testing within the subspecialty of 
mycology; or 

(e)(5)(i) Have earned a bachelor's degree ina 
chemical, physical or biological science or 
medical technology from an accredited institution; 
and 

(e)(5)(ii) Have at least 4 years of laboratory 


| training or experience, or both, in high complexity 


testing within the specialty of microbiology with a 


| minimum of 6 months experience in high 


complexity testing within the subspecialty of 


| mycology. 


(f) If the requirements of paragraph (b) of this 


| section are not met and the laboratory performs 


tests in the subspecialty of parasitology, the 


| individual functioning as the technical supervisor 


must-- 
(f)(1)(i) Be a doctor of medicine or a doctor of 


| osteopathy licensed to practice medicine or 


osteopathy in the State in which the laboratory is 
located; and 

(f)(1)(ii) Be certified in clinical pathology by the 
American Board of Pathology or the American 
Osteopathic Board of Pathology or possess 
qualifications that are equivalent to those required 
for such certification; or 

(f)(2)(i) Be a doctor of medicine, doctor of 
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| osteopathy, or doctor of podiatric medicine 
licensed to practice medicine, osteopathy, or 
podiatry in the State in which the laboratory is 
located; and 

(f}(2)(ii) Have at least one year of laboratory 
training or experience, or both, in high complexity | 
testing within the specialty of microbiology with a 
minimum of 6 months experience in high 
complexity testing within the subspecialty of 
parasitology; 

(f)(3)() Have an earned doctoral degree ina 
chemical, physical, biological or clinical laboratory | 
science from an accredited institution; and 

(f)(3)(ii) Have at least 1 year of laboratory training 
or experience, or both, in high complexity testing 
within the specialty of microbiology with a 
minimum of 6 months experience in high 
complexity testing within the subspecialty of 
parasitology; or 

(f)(4)() Have earned a master's degree ina 
chemical, physical, biological or clinical laboratory 
science or medical technology from an accredited 
institution; and 

(f}(4)(i) Have at least 2 years of laboratory 

training or experience, or both, in high complexity 

| testing within the specialty of microbiology with a 

| minimum of 6 months experience in high 

| complexity testing within the subspecialty of 

| parasitology; or 

| (f)(5)(i) Have earned a bachelor's degree ina 

| chemical, physical or biological science or 

| medical technology from an accredited institution; 
and 

| (f)(5)(ii) Have at least 4 years of laboratory 

training or experience, or both, in high complexity | 
testing within the specialty of microbiology with a 
minimum of 6 months experience in high 
complexity testing within the subspecialty of 
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parasitology. 

| (g) if the requirements of paragraph (b) of this 

_ section are not met and the laboratory performs 
tests in the subspecialty of virology, the individual 
functioning as the technical supervisor must-- 
(g)(1}(i) Be a doctor of medicine or doctor of 
osteopathy licensed to practice medicine or 
osteopathy in the State in which the laboratory is 
located; and 

' (g)(1)(ii) Be certified in clinical pathology by the 

| American Board of Pathology or the American 
Osteopathic Board of Pathology or possess 
qualifications that are equivalent to those required 
for such certification; or 

(g)(2)(i) Be a doctor of medicine, doctor of 
osteopathy, or doctor of podiatric medicine 

' licensed to practice medicine, osteopathy, or 

| podiatry in the State in which the laboratory is 
located; and 

(g)(2)(ii) Have at least 1 year of laboratory training 
or experience, or both, in high complexity testing 
within the specialty of microbiology with a 
minimum of 6 months experience in high 
complexity testing within the subspecialty of 
virology; or 

(g)(3){i) Have an earned doctoral degree ina 
chemical, physical, biological or clinical laboratory 
science from an accredited institution; and 
(g)(3)(ii) Have at least 1 year of laboratory training 
or experience, or both, in high complexity testing 
within the specialty of microbiology with a 
minimum of 6 months experience in high 
complexity testing within the subspecialty of 
virology; or 

(g)(4)(i) Have earned a master's degree in a 
chemical, physical, biological or clinical laboratory 
science or medical technology from an accredited | 
institution; and | 
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(g)(4){ii) Have at least 2 years of laboratory 
training or experience, or both, in high complexity 
testing within the specialty of microbiology with a 
minimum of 6 months experience in high 
complexity testing within the subspecialty of 
virology; or 

(g)(5){i) Have earned a bachelor's degree in a 

| chemical, physical or biological science or 
medical technology from an accredited institution; 
/and 

(g)(5)(li) Have at least 4 years of laboratory 

| training or experience, or both, in high complexity 
| testing within the specialty of microbiology with a 
| minimum of 6 months experience in high 

| complexity testing within the subspecialty of 
virology. 

| (h) If the requirements of paragraph (b) of this 

| section are not met and the laboratory performs 

| tests in the specialty of diagnostic immunology, 

| the individual functioning as the technical 
supervisor must- 

(h)(1)(i} Be a doctor of medicine or a doctor of 
osteopathy licensed to practice medicine or 
osteopathy in the State in which the laboratory is 
located; and 

(h}(1)(ii) Be certified in clinical pathology by the 
American Board of Pathology or the American 
Osteopathic Board of Pathology or possess 
qualifications that are equivalent to those required 
for such certification; or 

(h)(2)(i) Be a doctor of medicine, doctor of 
osteopathy, or doctor of podiatric medicine 
licensed to practice medicine, osteopathy, or 
podiatry in the State in which the laboratory is 
located; and 

(h)(2)(ii) Have at least 1 year of laboratory training 
or experience, or both, in high complexity testing 
for the specialty of diagnostic immunclogy; or 
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(n)(3)(i) Have an earned doctoral degree in a 
chemical, physical, biological or clinical laboratory 
science from an accredited institution; and 
(h)(3)(ii) Have at least 1 year of laboratory training 
or experience, or both, in high complexity testing 
within the specialty of diagnostic immunology; or 
(h)(4)(i) Have earned a master's degree in a 
chemical, physical, biological or clinical laboratory 
science or medical technology from an accredited 
institution; and 

(h)(4)(ii) Have at least 2 years of laboratory 
training or experience, or both, in high complexity 
testing for the specialty of diagnostic immunology; 
or 

(h)(5)(i) Have earned a bachelor's degree in a 
chemical, physical or biological science or 
medical technology from an accredited institution; 
and 

(h)(5)(it) Have at least 4 years of laboratory 
training or experience, or both, in high complexity 
: testing for the specialty of diagnostic immunology. 
(i) lf the requirements of paragraph (b) of this 

_ section are not met and the laboratory performs 

| tests in the specialty of chemistry, the individual 

i functioning as the technical supervisor must-- 
(i)(1}{i) Be a doctor of medicine or doctor of 
osteopathy licensed to practice medicine or 
osteopathy in the State in which the laboratory is 
located; and 

(i)(1)(i) Be certified in clinical pathology by the 
American Board of Pathology or the American 
Osteopathic Board of Pathology or possess 
qualifications that are equivalent to those required 
for such certification; or 

(i)(2)(i) Be a doctor of medicine, doctor of 
osteopathy, or doctor of podiatric medicine 
licensed to practice medicine, osteopathy, or 
podiatry in the State in which the laboratory is 
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located; and 

(i)(2){ii) Have at least 1 year of laboratory training 
or experience, or both, in high complexity testing 
for the specialty of chemistry; or 

(i)(3)(i) Have an earned doctoral degree ina 
chemical, physical, biological or clinical laboratory 
science from an accredited institution; and 
(i)(3)(ii) Have at least 1 year of laboratory training 
or experience, or both, in high complexity testing 
within the specialty of chemistry; or 

(i)(4)()) Have earned a master's degree ina 
chemical, physical, biological or clinical laboratory 
science or medical technology from an accredited 
institution; and 

(i)(4)(ii) Have at least 2 years of laboratory 
training or experience, or both, in high complexity 
testing for the specialty of chemistry; or 

(i)(5)(i) Have earned a bachelor's degree ina 
chemical, physical or biological science or 
medical technology from an accredited institution; 
and 

(i)(5)(ii)} Have at least 4 years of laboratory 
training or experience, or both, in high complexity 
testing for the specialty of chemistry. 

(j) lf the requirements of paragraph (b) of this 
section are not met and the laboratory performs 
tests in the specialty of hematology, the individual 
functioning as the technical supervisor must-- 
()(1)() Be a doctor of medicine or a doctor of 
osteopathy licensed to practice medicine or 
osteopathy in the State in which the laboratory is 

| located; and 

| §)()Gi) Be certified in clinical pathology by the 
American Board of Pathology or the American 

| Osteopathic Board of Pathology or possess 

| qualifications that are equivalent to those required 
for such certification; or 

(j)(2)()) Be a doctor of medicine, doctor of 
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osteopathy, or doctor of pediatric medicine 
licensed to practice medicine, osteopathy, or 
podiatry in the State in which the laboratory is 
located: and 

(j)(2)(ii) Have at least one year of laboratory 
training or experience, or both, in high complexity 
testing for the specialty of hematclogy (for 
example, physicians certified either in hematology 
or hematology and medical oncology by the 
American Board of Internal Medicine); or 

(j)(3)() Have an earned doctoral degree in a 
chemical, physical, biological or clinical laboratory 
science from an accredited institution; and 
(j)(3)(i) Have at least 1 year of laboratory training 
or experience, or both, in high complexity testing 
within the specialty of hematology; or 

(j)(4)(i) Have earned a master's degree in a 
chemical, physical, biological or clinical laboratory 
science or medical technology from an accredited 
institution; and 

(j)(4){ii) Have at least 2 years of laboratory 
training or experience, or both, in high complexity 
testing for the specialty of hematology; or 

(j)(5)(i) Have earned a bachelor's degree ina 
chemical, physical or biological science or 
medical technology from an accredited institution; 
and 

| (j)(5)(ii) Have at least 4 years of laboratory 

| training or experience, or both, in high complexity 
testing for the specialty of hematology. 

(k)(1) If the requirements of paragraph (b) of this 

| section are not met and the laboratory performs 
tests in the subspecialty of cytology, the individual | 
' functioning as the technical supervisor musi-- 
(k)(1)(i) Be a doctor of medicine or a doctor of 

| osteopathy licensed to practice medicine or 

, osteopathy in the State in which the laboratory is 
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(k}(1){ii) Meet one of the following 
requirements-- 
(k)(1)(ii)(A) Be certified in anatomic pathology by | 
the American Board of Pathology or the American | 
Osteopathic Board of Pathology or possess 
qualifications that are equivalent to those required | 
for such certification; or | 
(k)(1)(ii)(B) Be certified by the American Society 
of Cytology to practice cytopathology or possess 
qualifications that are equivalent to those required 
for such certification, 
(l) If the requirements of paragraph (b) of this 
section are not met and the laboratory performs 
tests in the subspecialty of histopathology, the 
individual functioning as the technical supervisor | 
must-- 
(I)\(1) Meet one of the following requirements: 
(1)(1)(i)(A) Be a doctor of medicine or a doctor of | 
osteopathy licensed to practice medicine or 
osteopathy in the State in which the laboratory is 
located: and 
(1)(1)(1)(B) Be certified in anatomic pathology by 
the American Board of Pathology or the American | 
Osteopathic Board of Pathology or possess 
qualifications that are equivalent to those required | 
for such certification; 

()(1)Gi) An individual qualified under 
§493.1449(b) or paragraph (1)(1) of this section | 
may delegate to an individual who is a resident in | 
a training program leading to certification 
specified in paragraph (b) or (1)(1)(i)(B) of this 
section, the responsibility for examination and 
interpretation of histopathology specimens. 
(\)(2) For tests in dermatopathology, meet one of | 
the following requirements: 

{l)(2)(i)(A) Be a doctor of medicine or doctor of 
osteopathy licensed to practice medicine or 
osteopathy in the State in which the laboratory is 
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located and-- 
(I)(2)()(B) Meet one of the following 

requirements: 
(1)(2)(})(B)(1) Be certified in anatomic pathology 
by the American Board of Pathology or the 
American Osteopathic Board of Pathology or 
possess qualifications that are equivalent to those 
required for such certification; or 
(1)(2)(i)(B)(2) Be certified in dermatopathology by 
the American Board of Dermatology and the 
American Board of Pathology or possess 
qualifications that are equivalent to those required 
for such certification; or 
()(2)()(B)(3) Be certified in dermatology by the 
American Board of Dermatology or possess 
qualifications that are equivalent to those required 
for such certification; or 
(I)(2)(ii) An individual qualified under 
§493.1449(b) or paragraph (1)(2)(i) of this section | 
may delegate to an individual who is a resident in | 
a training program leading to certification 
specified in paragraphs (b) or (l)(2)(i)(B) of this 
section, the responsibility for examination and 
interpretation of dermatopathology specimens. 

(1)(3) For tests in ophthalmic pathology, meet 
one of the following requirements: 
(1)(3)()(A) Be a doctor of medicine or doctor of 
osteopathy licensed to practice medicine or 
osteopathy in the State in which the laboratory is 
located and-- 
(I)(3)()(B) Must meet one of the following 
requirements: 
(I)(3)()(B)(1) Be certified in anatomic pathology 
by the American Board of Pathology or the 
American Osteopathic Board of Pathology or 
possess qualifications that are equivalent to those 
required for such certification; or 
(1)(3)()(B)(2) Be certified by the American Board 
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| of Ophthalmology or possess qualifications that 

| are equivalent to those required for such 

' certification and have successfully completed at 

least 1 year of formal post-residency fellowship 

| training in ophthalmic pathology; or 

()(3) ii) An individual qualified under 

§493.1449(b) or paragraph (1)(3){i) of this section 

may delegate to an individual who is a resident in 

a training program leading to certification 

specified in paragraphs (b) or (1)(3)(i)(B) of this 

section, the responsibility for examination and 

interpretation of ophthalmic specimens: or 

(m) If the requirements of paragraph (b) of this 

section are not met and the laboratory performs 

tests in the subspecialty of oral pathology, the 

individual functioning as the technical supervisor 

must meet one of the following requirements: 

(m)(1)(i) Be a doctor of medicine or a doctor of 

osteopathy licensed to practice medicine or 

osteopathy in the State in which the laboratory is | 

located and-- 

(m)(1)(ii) Be certified in anatomic pathology by the 

American Board of Pathology or the American | 

Osteopathic Board of Pathology or possess 

qualifications that are equivalent to those required 

for such certification; or 

(m){2) Be certified in oral pathology by the 

| American Board of Oral Pathology or possess 
qualifications for such certification; or 

| (m)(3) An individual qualified under §493.1449(b) 

or paragraph (m)(1) or (2) of this section may 

| delegate to an individual who is a resident in a 

training program leading to certification specified 

‘in paragraphs (b) or (m)(1) or (2) of this section, 

the responsibility for examination and 

| interpretation of oral pathology specimens. 

| (n) If the requirements of paragraph (b) of this 

| section are not met and the laboratory performs 
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tests in the specialty of radiobioassay, the 
individual functioning as the technical supervisor 
must-- 

(n)(1){i) Be a doctor of medicine or a doctor of 
osteopathy licensed to practice medicine or 
osteopathy in the State in which the laboratory is 
located; and 

' (n)(1)(ii) Be certified in clinical pathology by the 
American Board of Pathology or the American 
Osteopathic Board of Pathology or possess 
qualifications that are equivalent to those required 
for such certification; or 

i (n)(2)(i) Be a doctor of medicine, doctor of 
osteopathy, or doctor of podiatric medicine 

| licensed to practice medicine, osteopathy, or 
podiatry in the State in which the laboratory is 

| located; and 

(n}(2)(ii) Have at least 1 year of laboratory training 
or experience, or both, in high complexity testing 
for the specialty of radiobioassay; or 

(n)(3){i) Have an earned doctoral degree ina 
chemical, physical, biological or clinical laboratory 
science from an accredited institution; and 
(n)(3)(ii) Have at least 1 year of laboratory training 
or experience, or both, in high complexity testing 
within the specialty of radiobioassay; or 

(n)(4)(i) Have earned a master's degree ina 
chemical, physical, biological or clinical laboratory 
science or medical technology from an accredited 
institution; and 

(n)(4)(ii) Have at least 2 years of laboratory 
training or experience, or both, in high complexity | 
testing for the specialty of radiobioassay; or 
(n)(5)(i) Have earned a bachelor's degree in a 
chemical, physical or biological science or 
medical technology from an accredited institution; | 
and 


(n)(5){ii) Have at least 4 years of laboratory 
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training or experience, or both, in high complexity | 
testing for the specialty of radiobioassay. 
(o) If the laboratory performs tests in the specialty | 
of histocompatibility, the individual functioning as | 
the technical supervisor must either-- | 
(0)(1)(i) Be a doctor of medicine, doctor of 
osteopathy, or doctor of podiatric medicine 
licensed to practice medicine, osteopathy, or 
podiatry in the State in which the laboratory is 
located: and 
(0)(1)(ii) Have training or experience that meets 
one of the following requirements: 
(0)(1)(ii)(A) Have 4 years of laboratory training or 
experience, or both, within the specialty of 
histocompatibility; or 
(0)(1)(ii)(B)(1) Have 2 years of laboratory training 
or experience, or both, in the specialty of general 
immunology; and 
(0)(1)(i1)(B)(2) Have 2 years of laboratory training 
or experience, or both, in the specialty of 
histocompatibility; or 
| (0}(2)(1) Have an earned doctoral degree ina 
| biological or clinical laboratory science from an 
| accredited institution; and 

(0)(2)(ii) Have training or experience that 
meets one of the following requirements: 
(0)(2)(ii})(A) Have 4 years of laboratory training or 
experience, or both, within the specialty of 
histocompatibility; or 
(0)(2)(ii)(B)(1) Have 2 years of laboratory training | 
or experience, or both, in the specialty of general | 
immuncicgy; and 
(o)(2)(ii)(B)(2) Have 2 years of laboratory training 
or experience, or both, in the specialty of 
histocompatibility. 
(p) If the laboratory performs tests in the specialty 
of clinical cytogenetics, the individual functioning 
as the technical supervisor must-- 
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(p)(1}() Be a doctor of medicine, doctor of 
osteopathy, or doctor of podiatric medicine 
licensed to practice medicine, osteopathy, or 
podiatry in the State in which the laboratory is 
located: and 

(p)(1)(ii) Have 4 years of training or experience, 
or both, in genetics, 2 of which have been in 
clinical cytogenetics; or 

(p)(2}(i) Hold an earned doctoral degree ina 
biological science, including biochemistry, or 
clinical laboratory science from an accredited 
institution; and 

(p)(2)(ii) Have 4 years of training or experience, 
or both, in genetics, 2 of which have been in 
clinical cytogenetics. 

(q) If the requirements of paragraph (b) of this 
section are not met and the laboratory performs 
tests in the specialty of immunohematology, the 
individual functioning as the technical supervisor 
must-- 

(q)(1)(i) Be a doctor of medicine or a doctor of 
osteopathy licensed to practice medicine or 
osteopathy in the State in which the laboratory is 
located: and 

(q)(1)(i) Be certified in clinical pathology by the 
American Board of Pathology or the American 
Osteopathic Board of Pathology or possess 
qualifications that are equivalent to those required 
for such certification; or 


Note: The technical supervisor requirements for 
“laboratory training or experience, or both" in 
each specialty or subspecialty may be acquired 
concurrently in more than one of the specialties or 
subspeciaities of service. For example, an 
individual, who has a doctoral degree in chemistry 
i and additionally has documentation of 1 year of 


| laboratory experience working concurrently in 
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high complexity testing in the specialties of 
microbiology and chemistry and 6 months of that 
work experience included high complexity testing 
in bacteriology, mycology, and mycobacteriology, 
would qualify as the technical supervisor for the 
specialty of chemistry and the subspeciaities of 
bacteriology, mycology, and mycobacteriology. 


This STANDARD is not met as evidenced by: 
Based on review of training documentation, two 
of three technical supervisors failed to have the 
required 4 years of training or experience, or 
both, in a specialty or subspecialty as required to 
qualify as a technical supervisor. Findings 
include: 


a. Training documents from the personnel file 
for three technical supervisors were reviewed. 


b. Technical Supervisor #1 (TS1) and the 
QA/QC Manager stated thai all training 
documentation was kept in the personnel file for 
each employee. 


c. TS1 was unable to provided documentation 
which showed 4 years of training and/or 
experience in high complexity testing for 

| hematology or immunology. 


id. Technical Supervisor #2 (TS2) was unable to 
| provided documentation which showed 4 years of 
| training and/or experience in high complexity 

| testing for hematology, chemistry or immunology. 


1e. TS1 confirmed on 9/23/2015 at 10:30 am that 
| the documentation did not show the required 
| training or experience in immunology and 


_ hematology for TS1. | 
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f. TS2 confirmed on 11/18/2015 at 
approximately 9:50 am that the documentation 
did not show the required training or experience 
in hematology, chemistry or immunology for TS2. 
493.1451(b)(2) TECHNICAL SUPERVISOR 
RESPONSIBILITIES 


The technical supervisor is responsible for 
verification of the test procedures performed and 
establishment of the laboratory's test 
performance characteristics, including the 
precision and accuracy of each test and test 
system. 

This STANDARD is not met as evidenced by: 
Based on review of validation documents on the 
Theranos Proprietary System (TPS), the technical 

supervisor failed to ensure that the validation 
procedures performed on the TPS established 
performance specifications for accuracy, 
precision, reportable range, and/or reference 
range and failed to ensure establishment of the 
| performance specifications followed the 
laboratory's procedures. Findings include: 


a. Validations Reports for Vitamin D (VitD), Total 
T3 (TT3), Human Chorionic Gonadotropin (HCG), 
and Sex Hormone Binding Globulin (SHBG) were 
reviewed. 


| b. The laboratory presented the procedure, CL 

| PLN-14003 Revision A, "Master Validation Plan 

| for Routine Chemistry Assays on Theranos 

| Devices," when the surveyor requested their 

| procedure for establishing performance 
specifications. 


c. VitD, HCG, and SHBG validation reports 
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included "Theranos-corrected" results without an | 
explanation as to how the "Theranos Result” was | 
corrected or which result was reported. 


d. The procedure requires in Section 4.1 that 
the laboratory director (LD) ensures that the : 
chemistry assays are qualified and validated | 
according to the procedure. 


e. The validation report for SHBG had an : 
effective date of 7/14/14 but was not signed by ; 
the LD until 9/19/15. SHBG testing was : 
performed on the TPS from 7/28/14 through 


6/24/15. 
Accuracy | | 


a. The procedure required in Section 16 that the 
samples used to calculate accuracy were to cover | 
the entire reportable range, samples were tobe | 
run in at least 2 replicates, and 50% of samples 
were to be outside the reference range. 


b. VitD, TT3, HCG, and SHBG reports ail 
indicated that the predicate method was 
performed in duplicate, but did not indicate if TPS 
samples were run in duplicate. 


c. 113 had a reportable range of 47.6-1420 
ng/dL however the accuracy data only covered 
the range of 42,8-350 ng/dL. 


d. The laboratory used a total of 148 specimens 
to perform the accuracy study for SHBG. Of the 
148 specimens only six (4%) were outside the 
reference range. 50% of the specimens were not 
outside the reference range as required. 


Precision 
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a. The procedure required in Section 13 that the 
samples used to calculate precision were to cover 
the entire reportable range, include data frorn the 
familiarization study, include at least 1 quality 
control sample, have study performed over 20 
operating days, and have a CV% less than or 
equal to 15% (less than or equal to 20% at the 
lower and upper level of detection). 


b. VitD, TT3, HCG, and SHBG reports revealed 
that none of the precision studies covered 20 
operating days. 


c. VitD and TTS reports revealed that the 
precision study did not cover the entire reportable 
range. 


d. VitD, TT3, HCG, and SHBG reports did not 
document that the familiarization data was used 
in the validation report and did not document 1 

' level of quality control was included in the study. 


/€. VitD precision data showed that two of three 
| levels (15, 33.5 ng/mL) used showed a CV% 
greater than 20% and 15% respectively. 


f. TT3 precision data showed that two of three 
levels (85, 109 ng/dL) used showed a CV% 
greater than 15%. 


g. SHBG precision revealed that 47 of 96 
samples had %CV greater than 20%. 


Reportable Range 


a. The procedure required in Section 17 that the 
samples used to calculate reportable range were 
to cover the entire reportable range. 
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b. The validation report for VitD stated that the 
reportable range was 10-150 ng/mL. Samples 
tested covered a range of 14.17-108.25 ng/mL. 


c. The validation report for TT3 stated that the 
reportable range was 47.6-1420 ng/dL. Samples 
tested covered a range of less than 40-266 ng/dL. 


d. The validation report for SHBG stated that 
the reportable range was 2.5-200 nM. Samples 
| tested covered a range of 2.4-106 nM. 


'e. The validtion report for SHBG also stated that 
| the R2 value for the dilution linearity should be 

: equal to or greater than 0.95. However, the 
valuation report states on page 46 that"Two of =| 
the seven samples did not meet the optimal 
percent recovery and show slighty higher % | 
recovery than the upper desired limit, however 
the R2 value of 0.92 seems very compariable to 
the 0.95 acceptance value." 


Reference Range 


a. The procedure required in Section 18 that the 
reference range data should include "...a 
minimum of 120 samples for each partition. For 
instance, ifa reference interval needs partitions 
for gender, then samples from 120 men and 120 
women will be needed." 


b. Reference range data for VitD, TT3, and 
HCG included 20 samples. 


| c. Reference range data for SHBG included 14 
| samples from females and 10 samples from 


males. 
FORM CMS-2567(02-99) Previous Versions Obsolete Event ID: W34211 Facility ID: CA22046272 if continuation sheet Page 112 of 121 
FOIA Confidential Treatment Requested by Theranos TS-0917998 


Trial Exh. 4621 Page 0116 ER-5573 


Case: 22-10338, 05/04/2023, ID: 12709436, DktEntry: 22-21, Page 180 Of ARE Ep. 01/25/2016 
DEPARTMENT OF HEALTH AND HUMAN SERVICES FORM APPROVED 
CENTERS FOR MEDICARE & MEDICAID SERVICES OMB NO. 0938-0391 


STATEMENT OF DEFICIENCIES (X1) PROVIDER/SUPPLIER/CLIA (X2) MULTIPLE CONSTRUCTION (X3) DATE SURVEY 
AND PLAN OF CORRECTION IDENTIFICATION NUMBER: A. BUILDING COMPLETED 


0502025714 B. WING 41/20/2015 
NAME OF PROVIDER OR SUPPLIER STREET ADDRESS, CITY, STATE, ZIP CODE 
7333 GATEWAY BLVD 
NEWARK, CA 94560 


SUMMARY STATEMENT OF DEFICIENCIES PROVIDER'S PLAN OF CORRECTION (X5) 
(EACH DEFICIENCY MUST BE PRECEDED BY FULL (EACH CORRECTIVE ACTION SHOULD BE COMPLETION 
REGULATORY OR LSC IDENTIFYING INFORMATION) GROSS-REFERENCED TO THE APPROPRIATE DATE 
DEFICIENCY) 


THERANOS INC 


Continued From page 112 
Percent (%) Recovery 


a. The laboratory validation reports required a 
Recovery Rate of 100 +/- 20% (100 +/- 25% at 
the upper limit and lower limit of reportable range) | 
for VitD, TT3, and SHBG. 


b. The "Clinical Correlation (Historical)" table, 
Table 7, for VitD revealed that twelve (12) of 
twenty nine (29) samples showed a % Recovery 
greater than +/- 20%. Ten (10) of the 12 samples | 
had a % Recovery greater than +/- 25%. Of | 
these 10 samples, eight of ten were not at the 
upper or lower limit of the reportable range. 


c. The "Clinical Correlation (Historical)" table, 
Table 8, for VitD revealed that twenty eight (28) of 
eighty one (81) samples showed a % Recovery 
greater than +/- 20%. Twenty (20) of the 28 
samples had a % Recovery greater than +/- 25%. 
Of these 28 samples, seventeen (17) of twenty 
eight (28) were not at the upper or lower limit of 
the reportable range. 


i 


i'd. The "Clinical Correlation and Bias Correction" 
‘table, Table 6, for TT3 revealed that thirty six (36) 
of one hundred and seven (107) samples 
showed a % Recovery greater than +/- 20%. 
Twenty four (24) of the 36 samples had a % 
Recovery greater than +/- 25%. Of these 36 
samples, 23 of 36 were not at the upper or lower 
limit of the reportable range. 


e. The "Dilution Linearity” table, Table 21, for 
SHBG revealed that the 1:2 dilution (nominal 
value = 53.4 nM) had a % Recovery of 131% and 
the 1:64 dilution (nominal value 2.4 nM) had a % 
Recovery of 150%. The laboratory's reportable 
range for SHBG was 2.5-200 nM. 
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f. The “Summary of normal patient samples for 
Reference Range" table, Table 24, for SHBG 

i revealed that ten (10) of fourteen (14) samples 
for females and nine (9) of ten (10) samples for 
males showed a % Recovery greater than +/- 
20%. Fourteen (14) of the twenty four (24) total 
samples had a % Recovery greater than +/- 25%. 
| Of these 24 samples, 24 of 24 were not at the 

| upper or lower limit of the reportable range. 


Allowable Bias 


1a. The Alternative Assessment Program 

| procedure stated that allowable bias between a 
predicate method and the Theranos Proprietary 
System (TPS) was equal to or less than 20%. 


bd. The terms Total Allowable Error and 
| Allowable Bias seemed to be used 
| interchangably. 


ic. The formula used to determine allowable bias 
was: Laboratory value minus the Predicate value 
divided by Predicate value (Laboratory value - 
Predicate value/Predicate value). 


id. Nine random samples (01, 20, 30, 41, 91, 32, 
_ 74, H2, H58) were reviewed from the VitD clinical 
i correlation studies (Table 7 and 8) from the 
validation report. The allowable bias calculation 
for these nine samples ranged from 21-130%. 
The reference ranges for both the Predicate 

| method and the TPS were the same for VitD. 


'e, Nine random samples (2, 60, 62, 18, 57, 43, 
68, 73, 92) were reviewed from the TTS clinical 
correlation study (Table 6) from the validation 
report. The allowable bias calculation for these 


FORM CMS-2567(02-99) Previous Versions Obsolete Event iD: W34211 Facility ID: CA22046272 {f continuation sheet Page 114 of 121 


FOIA Confidential Treatment Requested by Theranos TS-0918000 
Trial Exh. 4621 Page 0118 ER-5575 


Case: 22-10338, 05/04/2023, ID: 12709436, DktEntry: 22-21, Page 182 of 188 
PRINTED: 01/25/2016 
DEPARTMENT OF HEALTH AND HUMAN SERVICES FORM APPROVED 


CENTERS FOR MEDICARE & MEDICAID SERVICES OMB NO. 0938-0397 


STATEMENT OF DEFICIENCIES (X1) PROVIDER/SUPPLIER/CLIA (X2) MULTIPLE CONSTRUCTION (X3) DATE SURVEY 
AND PLAN OF CORRECTION IDENTIFICATION NUMBER: A. BUILDING COMPLETED 


05D2025714 BE WING so 41/20/2015 
NAME OF PROVIDER OR SUPPLIER STREET ADDRESS, CITY, STATE, ZIP CODE 
7333 GATEWAY BLVD 
NEWARK, CA 94560 


(x4) 1D SUMMARY STATEMENT OF DEFICIENCIES PROVIDER'S PLAN OF CORRECTION (x5) 
PREFIX (EACH DEFICIENCY MUST BE PRECEDED BY FULL (EACH CORRECTIVE ACTION SHOULD BE COMPLETION 
TAG REGULATORY OR LSC IDENTIFYING INFORMATION) i CROSS-REFERENCED TO THE APPROPRIATE DATE 
i DEFICIENCY) 


THERANOS INC 


D6115 | Continued From page 114 


| nine samples ranged from 21-39%. The 
| reference ranges for both the Predicate method 
and the TPS were the same for TTS. 


| f. Nine random samples (5, 8, 25, 36, 54, 74, 
76, 131, 145) were reviewed from the SHBG 

| clinical correlation study (Table 20) from the 

| validation report. The allowable bias calculation 
for these nine samples ranged from 22-146%. 
The reference ranges for both the Predicate 
method and the TPS were the same for SHBG. 
493.1451(b)(8)(iv) TECHNICAL SUPERVISOR 
RESPONSIBILITIES 


The procedures for evaluation of the competency 
of the staff must include, but are not limited to 
direct observation of performance of instrument 
maintenance and function checks. 

This STANDARD is not met as evidenced by: 
Based on review of the 2015 competency 
assessment form and interview, the technical 
supervisor failed to include direct observations of 
performance of instrument maintenance and 
function checks in competency assessment. 
Findings include: 


a. Competency Assessment form, CL 
FRM-0316-F59, stated the following: "Review 
documentation of assigned instrument 
maintenance and function checks as applicable." 


b. Testing personnel and the technical 
supervisor stated on 9/23/15 at approximately 
4:30 pm that instrument maintenance and 
function check documention was reviewed as 
part of annual competency assessment and that 
direct obervation of these activities was not 


performed. 
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493.1487 TESTING PERSONNEL 


The laboratory has a sufficient number of 


individuals who meet the qualification 
requirements of 

§493.1489 of this subpart to perform the functions | 
specified in §493.1495 of this subpart for the | 
volume and complexity of testing performed. 


This CONDITION is not met as evidenced by: 
Based on the number and severity of the 
deficiencies cited herein, the Condition: 
Laboratories performing high complexity testing; 
testing personnel was not met. The laboratory 
failed to have qualified testing personnel 
performing high complexity testing. Refer to 
D6170 and D6171. 

493.1489(a) TESTING PERSONNEL 
QUALIFICATIONS 


Each individual performing high complexity 
testing must possess a current license issued by 
the State in which the laboratory is located, if 
such licensing is required. 

This STANDARD is not met as evidenced by: 
Based on laboratory personnel interviews and 
WBC differential record review on November 17, 
2015, each individual performing high complexity 
WBC differential testing failed to possess a 
current license issued by the State of California. 
Findings included: 


a. For patient capillary specimens, it was the 
practice of the laboratory to use flow cytometry 
instrumentation to perform and report patient 
WBC differentials. 


b. Between June 1, 2015 and September 21, 
2015, California unlicensed testing personnel 
reviewed and released patient flow cytometry 
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WBC differential scatter plots. The scatter plots 
were released by California unlicensed testing 
personnel without any further review by a 
California licensed testing person. 


c. Between June 1, 2015 and September 21, 
2015, the laboratory reported 2,112 patient WBC 
differential performed using the flow cytometry 
instrumentation. 

493.1489(b) TESTING PERSONNEL 
QUALIFICATIONS 


(b) Meet one of the following requirements: 
(b)(1) Be a doctor of medicine, doctor of 
osteopathy, or doctor of podiatric medicine 
licensed to practice medicine, osteopathy, or 
podiatry in the State in which the laboratory is 
located or have earned a doctoral, master's or 
bachelor's degree in a chemical, physical, 
biological or clinical laboratory science, or 
medical technology from an accredited institution; 
(b}(2){i) Have earned an associate degree in a 
laboratory science, or medical laboratory 
technology from an accredited institution or-- 
(b)(2)(ii) Have education and training equivalent 
to that specified in paragraph (b)(2){i) of this 
section that inciudes-- 
(b)(2){ii)(A) At least 60 semester hours, or 
equivalent, from an accredited institution that, ata 
minimum, include either-- 

(b)(2){ii)(A)(1) 24 semester hours of 
medical laboratory technology courses; or 

(b)(2)(ii)(A)(2) 24 semester hours of 
science courses that include-- 

(b}(2)(ii)(A)(2)(i) Six semester 
hours of chemistry; 
(b)(2){ii)(A)(2) (ii) Six semester 

hours of biology; and 
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| laboratory training in each specialty in which the 

| individual performs high complexity testing. 

_ (b)(3) Have previously qualified or could have 

| qualified as a technologist under §493.1491 on or 
' before February 28, 1992; 

i (b)(4) On or before April 24, 1995 be a high 


specimen collection, including patient preparation, 


SUMMARY STATEMENT OF DEFICIENCIES 
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Continued From page 117 
(b)(2)(ii)(A)(2) (iii) Twelve 

semester hours of chemisiry, biology, or medical 
laboratory technology in any combination; and 

(b)(2)(i1)(B) Have laboratory training that 
includes either of the following: 
(b)(2)}(ii)(B}(1) Completion of a clinical laboratory 
training program approved or accredited by the 
ABHES, the CAHEA, or other organization 
approved by HHS. (This training may be included 
in the 60 semester hours listed in paragraph (b) 
(2)(ii)(A) of this section.) 
(b)(2)(i1)(B)(2) At least 3 months documented 


school graduate or equivalent and have either-- 
(b)(4)(i) Graduated from a medical laboratory or | 
clinical laboratory training program approved or 
accredited by ABHES, CAHEA, or other | 
organization approved by HHS; or | 
(b}(4)(ii) Successfully completed an official U.S. 
military medical laboratory procedures training 
course of at least 50 weeks duration and have 
held the military enlisted occupational specialty of 
Medical Laboratory Specialist (Laboratory 
Technician); 
(b}(5)(i) Until September 1, 1997-- 

(b)(5)()(A) Have earned a high school 
diploma or equivalent; and 
(b)(5){i)(B) Have documentation of training 
appropriate for the testing performed before 
analyzing patient specimens. Such training must 
ensure that the individual has-- 
(b)(5){i)(B)(1) The skills required for proper 
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if applicable, labeling, handling, preservation or 
fixation, processing or preparation, transportation 
and storage of specimens; 

(b)(5)(i)(B)(2) The skills required for implementing 
all standard laboratory procedures; 

(b)(5){i)(B)(3) The skills required for performing 
each test method and for proper instrument use; 
(b)(5)(i)(B)(4) The skills required for performing 


| preventive maintenance, troubleshooting, and 


calibration procedures related to each test 
performed; 

(b)(5)(i)(B)(5) A working knowledge of reagent 
stability and storage: 

(b)(5)(i)(B)(6) The skills required to implement the 


| quality control policies and procedures of the 
: Jaboratory: 


(b)(5)(i)(B}(7) An awareness of the factors that 
influence test results; and 

(b)(5){i)(B)(8) The skills required to assess and 
verify the validity of patient test results through 


| the evaluation of quality control values before 
_ reporting patient test results; and 


(b)(5)(i)(B)(8)(ii) As of September 1, 1997, be 
qualified under §493.1489(b)(1), (b)(2), or (b)(4), 
except for those individuals qualified under 
paragraph (b)(5)(i) of this section who were 


| performing high complexity testing on or before 
April 24, 1995; 
(b)(8) For blood gas analysis-- 


(b)(6)(i) Be qualified under §493.1489(b)(1), 
(b)(2), (b)(3), (b)(4), or (b)(5); 


(b)(6){ii) Have earned a bachelor's degree in 


| respiratory therapy or cardiovascular technology 
| from an accredited institution; or 
| (b)(6)(iii) Have earned an associate degree 


related to pulmonary function from an accredited 
institution; or 


(b)(7) For histopathology, meet the qualifications | 
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of §493.1449 (b) or (i) to perform tissue 
examinations. 


: This STANDARD is not met as evidenced by: 
Based on review of personnel documentation 
and interview, one of thirty five testing personnel 
(TP14)failed to meet the high complexity 
personnel educational qualifications. Findings 
include: 


a. Review of TP14's personnel records revealed 
a bachelors degree in Liberal Studies. 


b. The general supervisor and technical 

_ consultant stated that all personnel documents 
| were kept in the personnel records. 

\ 


c. No further records were identified which 
showed a bachelor's degree in a chemical, 
physical, biological, clinical laboratory science or 
medical technology. 
493.1495(b)(4) TESTING PERSONNEL 
RESPONSIBILITIES 


Each individual performing high complexity 
testing must follow the laboratory's established 
policies and procedures whenever test systems 
are not within the laboratory's established 
acceptable levels of performance. 
This STANDARD is not met as evidenced by: 
Based on laboratory personnel interviews and 
complete blood counts (CBC) quality control 
| 
! 


corrective action record review on September 23, 
2015, the testing personnel, high complexity 
testing, failed to follow the laboratory's 
established policies and procedures whenever 
CBC test systems were not with the laboratory's 
established acceptable levels of performance. 
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Findings included: 


ja. itwas the practice of the laboratory to use the 
stated values of commercially assayed quality 
conirol materials to monitor patient CBC testing 

' using the Drew 3 instrument. In the event any 
CBC quality control material test results did not 
fall within the stated assay values, laboratory 

| personnel were to follow the procedure detailed in 
_ the protocol titled "Quality Control (document 
number CL QOP-00013, revision F)." 


|b. Laboratory records for the Drew 3 instrument | 
the laboratory designated as "Drew #2" indicated | 
| that on July 11, 12, 14, and 16, 2015 CBC quality 
| control material test results failed to meet stated | 
assay values. The laboratory's documentation of | 
| these quality control failures indicated that the 
laboratory's "Quality Control" protocol was not | 
followed. 

c. Laboratory records indicated that the Drew 3 
instrument the laboratory designated as "Drew 
#2" was used to test and report 36 patient CBC 
specimens on July 11, 2015, 12 patient CBC 
specimens on July 12, 2015, 36 patient CBC 
specimens on July 14, 2015, and 45 patient CBC 
specimens on July 16, 2015. 
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